2023-02-11 09:53:29,784 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-11 09:53:30,029 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f 2023-02-11 09:53:30,042 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-11 09:53:30,043 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439, deleteOnExit=true 2023-02-11 09:53:30,043 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 09:53:30,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/test.cache.data in system properties and HBase conf 2023-02-11 09:53:30,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 09:53:30,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/hadoop.log.dir in system properties and HBase conf 2023-02-11 09:53:30,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 09:53:30,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 09:53:30,045 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 09:53:30,165 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-11 09:53:30,576 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 09:53:30,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 09:53:30,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 09:53:30,580 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 09:53:30,581 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 09:53:30,581 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 09:53:30,581 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 09:53:30,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 09:53:30,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 09:53:30,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 09:53:30,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/nfs.dump.dir in system properties and HBase conf 2023-02-11 09:53:30,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/java.io.tmpdir in system properties and HBase conf 2023-02-11 09:53:30,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 09:53:30,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 09:53:30,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 09:53:31,154 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 09:53:31,160 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 09:53:31,471 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-11 09:53:31,646 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-11 09:53:31,666 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 09:53:31,707 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 09:53:31,742 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/java.io.tmpdir/Jetty_localhost_33127_hdfs____nfwby8/webapp 2023-02-11 09:53:31,901 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33127 2023-02-11 09:53:31,921 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 09:53:31,921 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 09:53:32,502 WARN [Listener at localhost/39621] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 09:53:32,573 WARN [Listener at localhost/39621] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 09:53:32,595 WARN [Listener at localhost/39621] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 09:53:32,602 INFO [Listener at localhost/39621] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 09:53:32,606 INFO [Listener at localhost/39621] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/java.io.tmpdir/Jetty_localhost_35135_datanode____.4u8hrc/webapp 2023-02-11 09:53:32,700 INFO [Listener at localhost/39621] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35135 2023-02-11 09:53:32,974 WARN [Listener at localhost/44465] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 09:53:33,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xec86a2d3bda87997: Processing first storage report for DS-e7b77214-22dc-4368-95be-0d1433025025 from datanode d887973e-79f0-4a8e-b8a4-a839fbe55eb2 2023-02-11 09:53:33,371 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xec86a2d3bda87997: from storage DS-e7b77214-22dc-4368-95be-0d1433025025 node DatanodeRegistration(127.0.0.1:43125, datanodeUuid=d887973e-79f0-4a8e-b8a4-a839fbe55eb2, infoPort=33425, infoSecurePort=0, ipcPort=44465, storageInfo=lv=-57;cid=testClusterID;nsid=2045318240;c=1676109211247), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-11 09:53:33,371 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xec86a2d3bda87997: Processing first storage report for DS-1ed0b65c-832c-463a-a120-74ebc8a2d954 from datanode d887973e-79f0-4a8e-b8a4-a839fbe55eb2 2023-02-11 09:53:33,371 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xec86a2d3bda87997: from storage DS-1ed0b65c-832c-463a-a120-74ebc8a2d954 node DatanodeRegistration(127.0.0.1:43125, datanodeUuid=d887973e-79f0-4a8e-b8a4-a839fbe55eb2, infoPort=33425, infoSecurePort=0, ipcPort=44465, storageInfo=lv=-57;cid=testClusterID;nsid=2045318240;c=1676109211247), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 09:53:33,450 DEBUG [Listener at localhost/44465] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f 2023-02-11 09:53:33,511 INFO [Listener at localhost/44465] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439/zookeeper_0, clientPort=62294, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 09:53:33,526 INFO [Listener at localhost/44465] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62294 2023-02-11 09:53:33,534 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:33,537 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:34,187 INFO [Listener at localhost/44465] util.FSUtils(479): Created version file at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99 with version=8 2023-02-11 09:53:34,188 INFO [Listener at localhost/44465] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/hbase-staging 2023-02-11 09:53:34,516 INFO [Listener at localhost/44465] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-11 09:53:34,981 INFO [Listener at localhost/44465] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-11 09:53:35,012 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 09:53:35,013 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 09:53:35,013 INFO [Listener at localhost/44465] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 09:53:35,013 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 09:53:35,013 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 09:53:35,151 INFO [Listener at localhost/44465] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 09:53:35,220 DEBUG [Listener at localhost/44465] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-11 09:53:35,310 INFO [Listener at localhost/44465] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46823 2023-02-11 09:53:35,320 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:35,322 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:35,342 INFO [Listener at localhost/44465] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46823 connecting to ZooKeeper ensemble=127.0.0.1:62294 2023-02-11 09:53:35,384 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:468230x0, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 09:53:35,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46823-0x10042ccd8fe0000 connected 2023-02-11 09:53:35,413 DEBUG [Listener at localhost/44465] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 09:53:35,414 DEBUG [Listener at localhost/44465] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 09:53:35,417 DEBUG [Listener at localhost/44465] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 09:53:35,424 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46823 2023-02-11 09:53:35,425 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46823 2023-02-11 09:53:35,425 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46823 2023-02-11 09:53:35,425 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46823 2023-02-11 09:53:35,426 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46823 2023-02-11 09:53:35,431 INFO [Listener at localhost/44465] master.HMaster(439): hbase.rootdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99, hbase.cluster.distributed=false 2023-02-11 09:53:35,500 INFO [Listener at localhost/44465] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-11 09:53:35,500 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 09:53:35,500 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 09:53:35,500 INFO [Listener at localhost/44465] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 09:53:35,500 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 09:53:35,501 INFO [Listener at localhost/44465] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 09:53:35,505 INFO [Listener at localhost/44465] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 09:53:35,508 INFO [Listener at localhost/44465] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43463 2023-02-11 09:53:35,510 INFO [Listener at localhost/44465] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 09:53:35,516 DEBUG [Listener at localhost/44465] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 09:53:35,517 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:35,519 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:35,521 INFO [Listener at localhost/44465] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43463 connecting to ZooKeeper ensemble=127.0.0.1:62294 2023-02-11 09:53:35,524 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:434630x0, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 09:53:35,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43463-0x10042ccd8fe0001 connected 2023-02-11 09:53:35,525 DEBUG [Listener at localhost/44465] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 09:53:35,526 DEBUG [Listener at localhost/44465] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 09:53:35,527 DEBUG [Listener at localhost/44465] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 09:53:35,527 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43463 2023-02-11 09:53:35,528 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43463 2023-02-11 09:53:35,528 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43463 2023-02-11 09:53:35,528 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43463 2023-02-11 09:53:35,529 DEBUG [Listener at localhost/44465] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43463 2023-02-11 09:53:35,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:35,539 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 09:53:35,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:35,559 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 09:53:35,559 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 09:53:35,559 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:35,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 09:53:35,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46823,1676109214337 from backup master directory 2023-02-11 09:53:35,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 09:53:35,565 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:35,565 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 09:53:35,565 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 09:53:35,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:35,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-11 09:53:35,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-11 09:53:35,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/hbase.id with ID: 551b1a7c-be60-40fb-8212-f8faaa4e9a31 2023-02-11 09:53:35,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:35,699 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:35,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x78d81643 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:53:35,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31243b8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:53:35,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 09:53:35,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 09:53:35,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-11 09:53:35,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-11 09:53:35,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 09:53:35,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 09:53:35,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 09:53:35,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store-tmp 2023-02-11 09:53:36,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:36,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 09:53:36,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:53:36,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:53:36,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 09:53:36,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:53:36,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:53:36,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676109216269Disabling compacts and flushes for region at 1676109216269Disabling writes for close at 1676109216270 (+1 ms)Writing region close event to WAL at 1676109216270Closed at 1676109216270 2023-02-11 09:53:36,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/WALs/jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:36,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46823%2C1676109214337, suffix=, logDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/WALs/jenkins-hbase4.apache.org,46823,1676109214337, archiveDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/oldWALs, maxLogs=10 2023-02-11 09:53:36,345 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43125,DS-e7b77214-22dc-4368-95be-0d1433025025,DISK] 2023-02-11 09:53:36,352 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-11 09:53:36,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/WALs/jenkins-hbase4.apache.org,46823,1676109214337/jenkins-hbase4.apache.org%2C46823%2C1676109214337.1676109216304 2023-02-11 09:53:36,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43125,DS-e7b77214-22dc-4368-95be-0d1433025025,DISK]] 2023-02-11 09:53:36,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:53:36,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:36,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 09:53:36,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 09:53:36,472 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 09:53:36,479 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 09:53:36,507 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 09:53:36,518 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:36,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 09:53:36,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 09:53:36,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 09:53:36,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:53:36,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73359259, jitterRate=0.09313814342021942}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:53:36,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676109216443Initializing all the Stores at 1676109216445 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676109216446 (+1 ms)Cleaning up temporary data from old regions at 1676109216532 (+86 ms)Cleaning up detritus from prior splits at 1676109216533 (+1 ms)Region opened successfully at 1676109216547 (+14 ms) 2023-02-11 09:53:36,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 09:53:36,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 09:53:36,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 09:53:36,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 09:53:36,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 09:53:36,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 32 msec 2023-02-11 09:53:36,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 09:53:36,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 09:53:36,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 09:53:36,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 09:53:36,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 09:53:36,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 09:53:36,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 09:53:36,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 09:53:36,681 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:36,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 09:53:36,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 09:53:36,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 09:53:36,700 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 09:53:36,700 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 09:53:36,700 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:36,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,46823,1676109214337, sessionid=0x10042ccd8fe0000, setting cluster-up flag (Was=false) 2023-02-11 09:53:36,715 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:36,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 09:53:36,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:36,727 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:36,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 09:53:36,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:36,737 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp 2023-02-11 09:53:36,833 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(952): ClusterId : 551b1a7c-be60-40fb-8212-f8faaa4e9a31 2023-02-11 09:53:36,837 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 09:53:36,842 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 09:53:36,843 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 09:53:36,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 09:53:36,851 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 09:53:36,852 DEBUG [RS:0;jenkins-hbase4:43463] zookeeper.ReadOnlyZKClient(139): Connect 0x114e4c29 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:53:36,858 DEBUG [RS:0;jenkins-hbase4:43463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f89a070, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:53:36,858 DEBUG [RS:0;jenkins-hbase4:43463] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb62759, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 09:53:36,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 09:53:36,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 09:53:36,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 09:53:36,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 09:53:36,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 09:53:36,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:36,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 09:53:36,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:36,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676109246862 2023-02-11 09:53:36,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 09:53:36,867 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 09:53:36,867 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 09:53:36,874 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 09:53:36,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 09:53:36,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 09:53:36,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 09:53:36,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 09:53:36,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 09:53:36,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:36,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 09:53:36,886 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43463 2023-02-11 09:53:36,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 09:53:36,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 09:53:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 09:53:36,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 09:53:36,891 INFO [RS:0;jenkins-hbase4:43463] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 09:53:36,891 INFO [RS:0;jenkins-hbase4:43463] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 09:53:36,891 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 09:53:36,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676109216892,5,FailOnTimeoutGroup] 2023-02-11 09:53:36,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676109216892,5,FailOnTimeoutGroup] 2023-02-11 09:53:36,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:36,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 09:53:36,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:36,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:36,895 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46823,1676109214337 with isa=jenkins-hbase4.apache.org/172.31.14.131:43463, startcode=1676109215499 2023-02-11 09:53:36,912 DEBUG [RS:0;jenkins-hbase4:43463] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 09:53:36,957 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60841, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 09:53:36,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:36,982 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99 2023-02-11 09:53:36,982 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39621 2023-02-11 09:53:36,982 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 09:53:36,987 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 09:53:36,988 DEBUG [RS:0;jenkins-hbase4:43463] zookeeper.ZKUtil(162): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:36,988 WARN [RS:0;jenkins-hbase4:43463] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 09:53:36,988 INFO [RS:0;jenkins-hbase4:43463] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 09:53:36,989 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/WALs/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:36,990 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43463,1676109215499] 2023-02-11 09:53:36,997 DEBUG [RS:0;jenkins-hbase4:43463] zookeeper.ZKUtil(162): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:37,006 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 09:53:37,014 INFO [RS:0;jenkins-hbase4:43463] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 09:53:37,032 INFO [RS:0;jenkins-hbase4:43463] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 09:53:37,036 INFO [RS:0;jenkins-hbase4:43463] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:53:37,036 INFO [RS:0;jenkins-hbase4:43463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:37,037 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 09:53:37,044 INFO [RS:0;jenkins-hbase4:43463] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-11 09:53:37,044 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,044 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,045 DEBUG [RS:0;jenkins-hbase4:43463] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 09:53:37,046 INFO [RS:0;jenkins-hbase4:43463] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:37,046 INFO [RS:0;jenkins-hbase4:43463] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:37,046 INFO [RS:0;jenkins-hbase4:43463] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:37,061 INFO [RS:0;jenkins-hbase4:43463] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 09:53:37,063 INFO [RS:0;jenkins-hbase4:43463] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43463,1676109215499-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:37,078 INFO [RS:0;jenkins-hbase4:43463] regionserver.Replication(203): jenkins-hbase4.apache.org,43463,1676109215499 started 2023-02-11 09:53:37,078 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43463,1676109215499, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43463, sessionid=0x10042ccd8fe0001 2023-02-11 09:53:37,079 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 09:53:37,079 DEBUG [RS:0;jenkins-hbase4:43463] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:37,079 DEBUG [RS:0;jenkins-hbase4:43463] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43463,1676109215499' 2023-02-11 09:53:37,079 DEBUG [RS:0;jenkins-hbase4:43463] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:37,080 DEBUG [RS:0;jenkins-hbase4:43463] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:37,080 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 09:53:37,080 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 09:53:37,080 DEBUG [RS:0;jenkins-hbase4:43463] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:37,080 DEBUG [RS:0;jenkins-hbase4:43463] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43463,1676109215499' 2023-02-11 09:53:37,080 DEBUG [RS:0;jenkins-hbase4:43463] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 09:53:37,081 DEBUG [RS:0;jenkins-hbase4:43463] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 09:53:37,081 DEBUG [RS:0;jenkins-hbase4:43463] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 09:53:37,081 INFO [RS:0;jenkins-hbase4:43463] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 09:53:37,081 INFO [RS:0;jenkins-hbase4:43463] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 09:53:37,192 INFO [RS:0;jenkins-hbase4:43463] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43463%2C1676109215499, suffix=, logDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/WALs/jenkins-hbase4.apache.org,43463,1676109215499, archiveDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/oldWALs, maxLogs=32 2023-02-11 09:53:37,210 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43125,DS-e7b77214-22dc-4368-95be-0d1433025025,DISK] 2023-02-11 09:53:37,214 INFO [RS:0;jenkins-hbase4:43463] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/WALs/jenkins-hbase4.apache.org,43463,1676109215499/jenkins-hbase4.apache.org%2C43463%2C1676109215499.1676109217195 2023-02-11 09:53:37,214 DEBUG [RS:0;jenkins-hbase4:43463] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43125,DS-e7b77214-22dc-4368-95be-0d1433025025,DISK]] 2023-02-11 09:53:37,304 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 09:53:37,305 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 09:53:37,305 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99 2023-02-11 09:53:37,718 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:37,721 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 09:53:37,723 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/info 2023-02-11 09:53:37,724 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 09:53:37,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:37,725 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 09:53:37,728 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/rep_barrier 2023-02-11 09:53:37,729 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 09:53:37,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:37,730 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 09:53:37,732 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/table 2023-02-11 09:53:37,732 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 09:53:37,733 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:37,734 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740 2023-02-11 09:53:37,735 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740 2023-02-11 09:53:37,739 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 09:53:37,740 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 09:53:37,744 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:53:37,745 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62015785, jitterRate=-0.07589279115200043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 09:53:37,746 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676109217718Initializing all the Stores at 1676109217720 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676109217720Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676109217720Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676109217720Cleaning up temporary data from old regions at 1676109217737 (+17 ms)Cleaning up detritus from prior splits at 1676109217738 (+1 ms)Region opened successfully at 1676109217746 (+8 ms) 2023-02-11 09:53:37,746 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 09:53:37,746 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 09:53:37,746 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 09:53:37,746 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 09:53:37,746 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 09:53:37,747 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 09:53:37,748 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676109217746Disabling compacts and flushes for region at 1676109217746Disabling writes for close at 1676109217746Writing region close event to WAL at 1676109217747 (+1 ms)Closed at 1676109217747 2023-02-11 09:53:37,753 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 09:53:37,753 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 09:53:37,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 09:53:37,773 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 09:53:37,775 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 09:53:37,927 DEBUG [jenkins-hbase4:46823] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-11 09:53:37,930 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43463,1676109215499, state=OPENING 2023-02-11 09:53:37,937 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 09:53:37,940 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:37,940 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 09:53:37,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:53:38,128 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:38,131 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 09:53:38,134 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50724, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 09:53:38,146 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 09:53:38,146 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 09:53:38,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43463%2C1676109215499.meta, suffix=.meta, logDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/WALs/jenkins-hbase4.apache.org,43463,1676109215499, archiveDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/oldWALs, maxLogs=32 2023-02-11 09:53:38,166 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43125,DS-e7b77214-22dc-4368-95be-0d1433025025,DISK] 2023-02-11 09:53:38,170 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/WALs/jenkins-hbase4.apache.org,43463,1676109215499/jenkins-hbase4.apache.org%2C43463%2C1676109215499.meta.1676109218150.meta 2023-02-11 09:53:38,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43125,DS-e7b77214-22dc-4368-95be-0d1433025025,DISK]] 2023-02-11 09:53:38,171 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:53:38,172 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 09:53:38,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 09:53:38,192 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 09:53:38,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 09:53:38,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:38,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 09:53:38,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 09:53:38,201 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 09:53:38,202 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/info 2023-02-11 09:53:38,202 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/info 2023-02-11 09:53:38,203 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 09:53:38,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:38,204 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 09:53:38,205 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/rep_barrier 2023-02-11 09:53:38,205 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/rep_barrier 2023-02-11 09:53:38,206 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 09:53:38,207 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:38,207 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 09:53:38,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/table 2023-02-11 09:53:38,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/table 2023-02-11 09:53:38,209 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 09:53:38,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:38,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740 2023-02-11 09:53:38,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740 2023-02-11 09:53:38,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 09:53:38,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 09:53:38,221 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71043915, jitterRate=0.058636829257011414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 09:53:38,221 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676109218198Writing region info on filesystem at 1676109218199 (+1 ms)Initializing all the Stores at 1676109218200 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676109218200Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676109218200Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676109218200Cleaning up temporary data from old regions at 1676109218215 (+15 ms)Cleaning up detritus from prior splits at 1676109218216 (+1 ms)Running coprocessor post-open hooks at 1676109218221 (+5 ms)Region opened successfully at 1676109218221 2023-02-11 09:53:38,230 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676109218120 2023-02-11 09:53:38,247 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 09:53:38,248 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 09:53:38,249 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43463,1676109215499, state=OPEN 2023-02-11 09:53:38,252 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 09:53:38,252 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 09:53:38,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 09:53:38,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43463,1676109215499 in 310 msec 2023-02-11 09:53:38,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 09:53:38,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 496 msec 2023-02-11 09:53:38,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4870 sec 2023-02-11 09:53:38,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676109215555, completionTime=-1 2023-02-11 09:53:38,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-11 09:53:38,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 09:53:38,329 DEBUG [hconnection-0x6e2ece2a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:53:38,332 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50736, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:53:38,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-11 09:53:38,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676109278349 2023-02-11 09:53:38,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676109338349 2023-02-11 09:53:38,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 81 msec 2023-02-11 09:53:38,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1676109214337-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:38,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1676109214337-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:38,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1676109214337-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:38,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46823, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:38,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 09:53:38,380 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 09:53:38,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 09:53:38,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 09:53:38,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 09:53:38,401 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:53:38,403 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:53:38,426 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:38,428 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc empty. 2023-02-11 09:53:38,429 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:38,429 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 09:53:38,851 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 09:53:38,853 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 35649d2f915e53acc4ab9daa7e90d4fc, NAME => 'hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:53:38,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:38,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 35649d2f915e53acc4ab9daa7e90d4fc, disabling compactions & flushes 2023-02-11 09:53:38,865 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:53:38,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:53:38,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. after waiting 0 ms 2023-02-11 09:53:38,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:53:38,865 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:53:38,865 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 35649d2f915e53acc4ab9daa7e90d4fc: Waiting for close lock at 1676109218865Disabling compacts and flushes for region at 1676109218865Disabling writes for close at 1676109218865Writing region close event to WAL at 1676109218865Closed at 1676109218865 2023-02-11 09:53:38,869 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:53:38,883 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676109218872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109218872"}]},"ts":"1676109218872"} 2023-02-11 09:53:38,907 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:53:38,909 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:53:38,913 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109218909"}]},"ts":"1676109218909"} 2023-02-11 09:53:38,916 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 09:53:38,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=35649d2f915e53acc4ab9daa7e90d4fc, ASSIGN}] 2023-02-11 09:53:38,928 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=35649d2f915e53acc4ab9daa7e90d4fc, ASSIGN 2023-02-11 09:53:38,930 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=35649d2f915e53acc4ab9daa7e90d4fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:53:39,081 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=35649d2f915e53acc4ab9daa7e90d4fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:39,082 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676109219081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109219081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109219081"}]},"ts":"1676109219081"} 2023-02-11 09:53:39,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 35649d2f915e53acc4ab9daa7e90d4fc, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:53:39,246 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:53:39,247 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 35649d2f915e53acc4ab9daa7e90d4fc, NAME => 'hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:53:39,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:39,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:39,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:39,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:39,250 INFO [StoreOpener-35649d2f915e53acc4ab9daa7e90d4fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:39,252 DEBUG [StoreOpener-35649d2f915e53acc4ab9daa7e90d4fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/info 2023-02-11 09:53:39,253 DEBUG [StoreOpener-35649d2f915e53acc4ab9daa7e90d4fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/info 2023-02-11 09:53:39,253 INFO [StoreOpener-35649d2f915e53acc4ab9daa7e90d4fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35649d2f915e53acc4ab9daa7e90d4fc columnFamilyName info 2023-02-11 09:53:39,254 INFO [StoreOpener-35649d2f915e53acc4ab9daa7e90d4fc-1] regionserver.HStore(310): Store=35649d2f915e53acc4ab9daa7e90d4fc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:39,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:39,256 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:39,261 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:53:39,264 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:53:39,265 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 35649d2f915e53acc4ab9daa7e90d4fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67090432, jitterRate=-2.74658203125E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:53:39,265 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 35649d2f915e53acc4ab9daa7e90d4fc: Running coprocessor pre-open hook at 1676109219249Writing region info on filesystem at 1676109219249Initializing all the Stores at 1676109219250 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676109219250Cleaning up temporary data from old regions at 1676109219257 (+7 ms)Cleaning up detritus from prior splits at 1676109219257Running coprocessor post-open hooks at 1676109219265 (+8 ms)Region opened successfully at 1676109219265 2023-02-11 09:53:39,267 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc., pid=6, masterSystemTime=1676109219240 2023-02-11 09:53:39,271 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:53:39,271 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:53:39,272 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=35649d2f915e53acc4ab9daa7e90d4fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:39,273 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676109219271"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109219271"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109219271"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109219271"}]},"ts":"1676109219271"} 2023-02-11 09:53:39,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 09:53:39,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 35649d2f915e53acc4ab9daa7e90d4fc, server=jenkins-hbase4.apache.org,43463,1676109215499 in 190 msec 2023-02-11 09:53:39,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 09:53:39,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=35649d2f915e53acc4ab9daa7e90d4fc, ASSIGN in 353 msec 2023-02-11 09:53:39,284 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:53:39,284 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109219284"}]},"ts":"1676109219284"} 2023-02-11 09:53:39,287 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 09:53:39,290 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:53:39,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 900 msec 2023-02-11 09:53:39,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 09:53:39,303 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 09:53:39,303 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:53:39,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 09:53:39,358 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 09:53:39,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-02-11 09:53:39,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 09:53:39,386 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 09:53:39,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-11 09:53:39,403 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 09:53:39,406 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 09:53:39,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.842sec 2023-02-11 09:53:39,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 09:53:39,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 09:53:39,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 09:53:39,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1676109214337-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 09:53:39,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1676109214337-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 09:53:39,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 09:53:39,439 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(139): Connect 0x0629018b to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:53:39,443 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1e7f16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:53:39,456 DEBUG [hconnection-0x77bc4ff1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:53:39,467 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:53:39,477 INFO [Listener at localhost/44465] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:53:39,477 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(139): Connect 0x7defec53 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:53:39,483 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b944ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:53:39,483 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:53:39,504 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=286, ProcessCount=169, AvailableMemoryMB=3607 2023-02-11 09:53:39,514 DEBUG [Listener at localhost/44465] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:53:39,518 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35026, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:53:39,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 09:53:39,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:39,532 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:53:39,534 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:53:39,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-11 09:53:39,537 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:39,538 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca empty. 2023-02-11 09:53:39,540 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:39,540 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-11 09:53:39,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 09:53:39,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 09:53:39,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 09:53:39,957 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-11 09:53:39,959 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f82f0c310b3fe5314afe7844ad07bca, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:53:40,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 09:53:40,371 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:40,372 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 3f82f0c310b3fe5314afe7844ad07bca, disabling compactions & flushes 2023-02-11 09:53:40,372 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:40,372 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:40,372 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. after waiting 0 ms 2023-02-11 09:53:40,372 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:40,373 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:40,373 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 3f82f0c310b3fe5314afe7844ad07bca: Waiting for close lock at 1676109220372Disabling compacts and flushes for region at 1676109220372Disabling writes for close at 1676109220372Writing region close event to WAL at 1676109220372Closed at 1676109220373 (+1 ms) 2023-02-11 09:53:40,377 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:53:40,379 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676109220378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109220378"}]},"ts":"1676109220378"} 2023-02-11 09:53:40,381 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:53:40,383 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:53:40,383 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109220383"}]},"ts":"1676109220383"} 2023-02-11 09:53:40,385 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-11 09:53:40,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, ASSIGN}] 2023-02-11 09:53:40,391 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, ASSIGN 2023-02-11 09:53:40,393 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:53:40,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3f82f0c310b3fe5314afe7844ad07bca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:40,544 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676109220544"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109220544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109220544"}]},"ts":"1676109220544"} 2023-02-11 09:53:40,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 3f82f0c310b3fe5314afe7844ad07bca, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:53:40,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 09:53:40,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:40,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f82f0c310b3fe5314afe7844ad07bca, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:53:40,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:40,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:40,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:40,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:40,712 INFO [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:40,714 DEBUG [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:40,714 DEBUG [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:40,717 INFO [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f82f0c310b3fe5314afe7844ad07bca columnFamilyName family1 2023-02-11 09:53:40,720 INFO [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] regionserver.HStore(310): Store=3f82f0c310b3fe5314afe7844ad07bca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:40,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:40,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:40,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:40,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:53:40,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f82f0c310b3fe5314afe7844ad07bca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74799183, jitterRate=0.11459468305110931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:53:40,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f82f0c310b3fe5314afe7844ad07bca: Running coprocessor pre-open hook at 1676109220708Writing region info on filesystem at 1676109220708Initializing all the Stores at 1676109220710 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676109220710Cleaning up temporary data from old regions at 1676109220723 (+13 ms)Cleaning up detritus from prior splits at 1676109220724 (+1 ms)Running coprocessor post-open hooks at 1676109220732 (+8 ms)Region opened successfully at 1676109220732 2023-02-11 09:53:40,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca., pid=11, masterSystemTime=1676109220701 2023-02-11 09:53:40,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:40,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:40,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3f82f0c310b3fe5314afe7844ad07bca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:40,739 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676109220738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109220738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109220738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109220738"}]},"ts":"1676109220738"} 2023-02-11 09:53:40,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 09:53:40,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 3f82f0c310b3fe5314afe7844ad07bca, server=jenkins-hbase4.apache.org,43463,1676109215499 in 194 msec 2023-02-11 09:53:40,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-11 09:53:40,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, ASSIGN in 356 msec 2023-02-11 09:53:40,750 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:53:40,750 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109220750"}]},"ts":"1676109220750"} 2023-02-11 09:53:40,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-11 09:53:40,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:53:40,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2270 sec 2023-02-11 09:53:41,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-11 09:53:41,658 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-11 09:53:41,675 DEBUG [hconnection-0x611a5737-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:53:41,678 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50750, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:53:41,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:41,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,840 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:41,841 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:41,841 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:41,841 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:41,842 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,842 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:41,844 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:41,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:41,845 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:41,845 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:41,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:41,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:41,850 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:41,850 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:41,850 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:41,851 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:41,852 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 09:53:42,419 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303d3b6adf48cd4b12bf00de3adba52d11 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303d3b6adf48cd4b12bf00de3adba52d11 2023-02-11 09:53:42,440 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/0b03cbb431dc42689fcafe5c1ef5abb3 2023-02-11 09:53:42,451 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/0b03cbb431dc42689fcafe5c1ef5abb3 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/0b03cbb431dc42689fcafe5c1ef5abb3 2023-02-11 09:53:42,460 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/0b03cbb431dc42689fcafe5c1ef5abb3, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-11 09:53:42,463 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 611ms, sequenceid=5, compaction requested=false 2023-02-11 09:53:42,465 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:42,469 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:42,469 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:42,469 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:42,473 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,473 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:42,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:42,476 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:42,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a4d79fb[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:42,476 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,479 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,479 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:42,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,480 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:42,480 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:42,480 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:42,483 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,483 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:42,483 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:42,483 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:42,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:42,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:42,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:42,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:42,487 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:42,487 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:42,487 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:42,487 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,487 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:42,491 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,491 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:42,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,491 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:42,492 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:42,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:42,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:42,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,494 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:42,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,501 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,501 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:42,501 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,501 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:42,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:42,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:42,501 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:42,501 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:42,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:42,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:42,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:42,504 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:42,504 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:42,604 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:42,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:42,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:42,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:42,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,625 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:42,625 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:42,626 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:42,626 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:42,627 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,627 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,628 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:42,628 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:42,629 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:42,629 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,630 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,630 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:42,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:42,631 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:42,632 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:42,632 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 09:53:43,011 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 09:53:43,013 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 09:53:43,071 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112899703fd280be4217866b62f6c6588281 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112899703fd280be4217866b62f6c6588281 2023-02-11 09:53:43,489 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/dd4b46e7981d420cb70f87e5d45f1b66 2023-02-11 09:53:43,500 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/dd4b46e7981d420cb70f87e5d45f1b66 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/dd4b46e7981d420cb70f87e5d45f1b66 2023-02-11 09:53:43,509 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/dd4b46e7981d420cb70f87e5d45f1b66, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 09:53:43,510 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 878ms, sequenceid=9, compaction requested=false 2023-02-11 09:53:43,510 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:43,510 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:43,510 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:43,511 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:43,513 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:43,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:43,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:43,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:43,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17c4acd6[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:43,515 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:43,515 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,517 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,517 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:43,518 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:43,518 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:43,518 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,518 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:43,519 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,519 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:43,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,519 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:43,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:43,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:43,519 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:43,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:43,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:43,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:43,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:43,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:43,523 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:43,523 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:43,523 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:43,523 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,523 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:43,528 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,528 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:43,529 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:43,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:43,529 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,531 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:43,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:43,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:43,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:43,535 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:43,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:43,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:43,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 09:53:43,536 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,536 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,536 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:43,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:43,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:43,536 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,536 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:43,636 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:43,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:43,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:43,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:43,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,649 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:43,649 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:43,649 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:43,649 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:43,650 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,650 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:43,651 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:43,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:43,652 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:43,652 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:43,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:43,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,653 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,655 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:43,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:43,655 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:43,655 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:43,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:43,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:43,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:43,656 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:43,656 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:43,656 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:43,680 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120114b0f956c887442a99560993ba67613e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120114b0f956c887442a99560993ba67613e 2023-02-11 09:53:43,721 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:53:44,094 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/c155973832f34bd9957dd4f54e54c78a 2023-02-11 09:53:44,104 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/c155973832f34bd9957dd4f54e54c78a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/c155973832f34bd9957dd4f54e54c78a 2023-02-11 09:53:44,111 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/c155973832f34bd9957dd4f54e54c78a, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 09:53:44,112 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 456ms, sequenceid=13, compaction requested=true 2023-02-11 09:53:44,112 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:44,112 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:44,113 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:44,115 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,115 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:44,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:44,116 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,116 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:44,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:44,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:44,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@270cefa3[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:44,118 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:44,119 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,124 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,124 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:44,124 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:44,124 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:44,124 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,124 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:44,126 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,126 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:44,126 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:44,126 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:44,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:44,130 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:44,130 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:44,130 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:44,130 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,130 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:44,132 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,132 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:44,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,132 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:44,133 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:44,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:44,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:44,139 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:44,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 09:53:44,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:44,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:44,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:44,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:44,140 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,140 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,140 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,140 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:44,140 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:44,141 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:44,241 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:44,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:44,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:44,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:44,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,252 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:44,252 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:44,253 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:44,253 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:44,253 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,253 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,255 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:44,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:44,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:44,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:44,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:44,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:44,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,257 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:44,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:44,257 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:44,257 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:44,257 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:44,257 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:44,257 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:44,257 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:44,258 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:44,258 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:44,510 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 09:53:44,510 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-11 09:53:44,683 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205129e65d4313a4b4aaed5d2d390ba3442 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205129e65d4313a4b4aaed5d2d390ba3442 2023-02-11 09:53:45,098 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/65bc2fe9676546fe868474db6b7ed73e 2023-02-11 09:53:45,107 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/65bc2fe9676546fe868474db6b7ed73e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/65bc2fe9676546fe868474db6b7ed73e 2023-02-11 09:53:45,116 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/65bc2fe9676546fe868474db6b7ed73e, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 09:53:45,117 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 859ms, sequenceid=17, compaction requested=true 2023-02-11 09:53:45,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:45,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:45,117 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:45,121 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,121 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:45,121 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,121 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:45,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:45,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@82f71ab[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:45,124 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:45,124 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,125 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:45,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:45,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:45,125 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,125 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:45,128 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:45,128 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,128 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:45,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:45,128 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:45,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:45,132 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:45,132 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:45,132 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:45,132 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,132 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:45,134 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,134 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,134 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:45,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:45,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,137 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,143 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:45,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:45,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:45,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:45,144 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:45,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:45,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:45,144 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,144 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,144 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:45,144 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:45,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:45,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:45,245 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:45,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:45,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:45,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:45,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,256 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:45,256 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:45,256 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:45,256 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:45,257 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,257 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,258 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:45,258 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:45,259 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:45,259 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:45,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:45,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:45,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:45,261 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:45,261 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:45,261 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:45,261 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:45,684 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284955cbfe0e104692854443b667f0dc7d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512284955cbfe0e104692854443b667f0dc7d 2023-02-11 09:53:46,096 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/545206fe4a8644c484f6a21f4f2b614b 2023-02-11 09:53:46,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/545206fe4a8644c484f6a21f4f2b614b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/545206fe4a8644c484f6a21f4f2b614b 2023-02-11 09:53:46,112 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/545206fe4a8644c484f6a21f4f2b614b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 09:53:46,113 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 852ms, sequenceid=21, compaction requested=true 2023-02-11 09:53:46,113 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:46,113 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:46,114 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:46,119 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,120 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:46,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:46,120 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,120 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:46,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:46,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:46,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:46,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:46,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69cc53f4[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:46,122 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:46,122 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,123 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,123 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:46,123 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:46,123 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:46,124 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,124 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:46,125 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:46,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:46,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:46,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:46,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:46,129 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:46,129 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:46,129 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:46,129 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,129 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:46,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:46,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:46,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:46,131 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:46,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,133 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:46,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,138 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,138 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,138 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:46,138 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:46,138 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:46,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:46,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:46,138 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:46,138 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 09:53:46,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:46,139 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:46,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,139 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:46,240 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:46,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:46,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:46,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:46,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,250 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:46,251 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:46,251 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:46,251 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:46,252 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,252 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,253 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:46,253 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:46,253 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:46,253 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:46,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:46,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,254 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,255 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:46,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:46,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:46,255 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:46,256 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:46,256 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:46,679 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312fcafabd34bc45f68dc27e584d93884e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312fcafabd34bc45f68dc27e584d93884e 2023-02-11 09:53:47,088 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/4e19dc7e88364ead80cfecf1c24f7396 2023-02-11 09:53:47,131 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/4e19dc7e88364ead80cfecf1c24f7396 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/4e19dc7e88364ead80cfecf1c24f7396 2023-02-11 09:53:47,139 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/4e19dc7e88364ead80cfecf1c24f7396, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 09:53:47,140 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 884ms, sequenceid=25, compaction requested=true 2023-02-11 09:53:47,141 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:47,141 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:47,141 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:47,142 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,142 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:47,142 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:47,144 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,144 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:47,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:47,144 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,144 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:47,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:47,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:47,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b5ce007[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:47,147 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:47,147 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,149 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,149 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:47,149 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:47,149 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:47,149 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,149 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:47,152 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,152 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:47,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:47,152 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:47,152 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:47,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:47,156 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:47,156 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:47,156 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:47,156 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,156 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:47,158 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,158 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:47,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:47,159 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,161 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:47,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:47,166 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:47,166 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:47,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 09:53:47,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:47,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:47,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:47,167 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:47,268 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:47,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:47,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:47,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:47,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,279 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:47,279 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:47,280 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:47,280 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:47,280 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,280 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,282 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,282 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:47,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:47,282 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:47,282 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:47,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,284 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,284 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:47,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:47,285 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:47,285 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:47,285 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:47,285 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:47,707 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019648dc9e8ad643918b8f1d5c0adbe44f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601019648dc9e8ad643918b8f1d5c0adbe44f 2023-02-11 09:53:48,116 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/19bc13a6a7cd4e298537f4c7617b193f 2023-02-11 09:53:48,124 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/19bc13a6a7cd4e298537f4c7617b193f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/19bc13a6a7cd4e298537f4c7617b193f 2023-02-11 09:53:48,133 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/19bc13a6a7cd4e298537f4c7617b193f, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 09:53:48,134 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 849ms, sequenceid=29, compaction requested=true 2023-02-11 09:53:48,135 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:48,135 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:48,135 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:48,135 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:48,135 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,135 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:48,135 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:48,139 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,139 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:48,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:48,139 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,139 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:48,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:48,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:48,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:48,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:48,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bed6d38[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:48,141 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:48,141 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,143 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:48,143 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:48,143 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:48,143 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,143 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:48,145 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:48,145 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,145 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:48,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:48,145 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:48,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:48,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:48,148 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:48,148 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:48,148 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:48,148 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,148 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:48,150 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,150 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,150 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:48,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:48,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:48,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,151 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:48,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:48,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:48,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:48,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,152 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:48,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:48,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:48,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:48,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:48,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:48,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:48,159 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,159 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:48,160 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,160 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:48,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:48,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 09:53:48,160 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:48,161 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:48,261 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:48,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:48,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:48,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:48,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,272 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:48,272 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:48,273 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:48,273 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:48,273 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,273 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,274 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:48,274 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:48,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:48,275 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:48,275 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:48,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,276 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,276 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:48,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:48,276 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:48,276 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:48,276 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:48,277 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:48,277 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:48,277 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:48,698 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f416871440a14df9a3be200d6339c9ab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103f416871440a14df9a3be200d6339c9ab 2023-02-11 09:53:49,107 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/9fa6601a43bd44ff8d7b635cb32aab46 2023-02-11 09:53:49,115 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/9fa6601a43bd44ff8d7b635cb32aab46 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/9fa6601a43bd44ff8d7b635cb32aab46 2023-02-11 09:53:49,122 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/9fa6601a43bd44ff8d7b635cb32aab46, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 09:53:49,123 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 846ms, sequenceid=33, compaction requested=true 2023-02-11 09:53:49,123 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:49,123 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:49,123 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:49,124 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:49,124 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,124 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:49,124 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:49,126 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,126 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:49,126 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,126 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:49,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:49,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:49,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@683cf5c7[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:49,128 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:49,128 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,129 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,129 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:49,129 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:49,129 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:49,130 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,130 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:49,131 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:49,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,132 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,132 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:49,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:49,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:49,135 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:49,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:49,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:49,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,135 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:49,137 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,137 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:49,137 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,137 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:49,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:49,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,139 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,142 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:49,142 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,142 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:49,142 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:49,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:49,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:49,142 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:49,142 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,143 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,143 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:49,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:49,143 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:49,243 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:49,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:49,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:49,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:49,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,254 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:49,254 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:49,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:49,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:49,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,257 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,257 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:49,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:49,257 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:49,257 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,258 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,258 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:49,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:49,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:49,260 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:49,260 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:49,260 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:49,680 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090730b22f1c6d2446ec9ca3998e22fda174 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090730b22f1c6d2446ec9ca3998e22fda174 2023-02-11 09:53:50,089 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/17c8c98739ab4869b9f76c7ee808cbfe 2023-02-11 09:53:50,098 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/17c8c98739ab4869b9f76c7ee808cbfe as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/17c8c98739ab4869b9f76c7ee808cbfe 2023-02-11 09:53:50,105 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/17c8c98739ab4869b9f76c7ee808cbfe, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 09:53:50,106 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 846ms, sequenceid=37, compaction requested=true 2023-02-11 09:53:50,106 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:50,106 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:50,106 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:50,107 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:50,107 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,107 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:50,107 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:50,109 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,109 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:50,109 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:50,109 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:50,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:50,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:50,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@636448c7[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:50,111 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:50,111 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,112 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,112 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:50,112 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:50,112 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:50,112 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,112 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:50,113 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:50,113 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,113 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:50,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:50,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:50,114 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:50,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:50,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:50,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:50,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:50,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:50,117 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:50,117 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:50,117 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:50,117 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,117 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:50,119 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,119 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,120 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:50,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:50,120 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:50,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,122 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:50,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,124 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,124 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,124 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:50,124 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:50,124 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:50,124 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:50,124 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:50,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:50,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:50,125 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,125 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,125 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 09:53:50,125 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:50,125 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:50,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:50,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:50,226 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:50,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:50,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:50,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:50,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,236 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:50,236 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:50,237 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-11 09:53:50,237 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-11 09:53:50,237 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,237 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,239 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,239 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:50,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:50,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:50,239 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:50,239 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:50,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:50,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,240 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,240 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-11 09:53:50,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:50,240 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-11 09:53:50,240 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:50,241 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-11 09:53:50,241 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:50,241 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:50,241 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:50,242 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. started... 2023-02-11 09:53:50,242 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3f82f0c310b3fe5314afe7844ad07bca 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:50,661 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205f79a4e90d154ed9a071110cce9dfe5f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205f79a4e90d154ed9a071110cce9dfe5f 2023-02-11 09:53:51,072 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/5ea807fdb1d848f88917343727a1c61c 2023-02-11 09:53:51,079 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/5ea807fdb1d848f88917343727a1c61c as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/5ea807fdb1d848f88917343727a1c61c 2023-02-11 09:53:51,085 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/5ea807fdb1d848f88917343727a1c61c, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 09:53:51,086 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3f82f0c310b3fe5314afe7844ad07bca in 844ms, sequenceid=41, compaction requested=true 2023-02-11 09:53:51,087 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:51,087 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:51,087 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:51,087 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:51,087 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,087 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-11 09:53:51,087 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-11 09:53:51,089 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,089 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:51,090 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,090 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:51,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:51,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:51,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-11 09:53:51,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f84d074[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:51,091 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-11 09:53:51,092 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,093 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,094 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-11 09:53:51,094 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,094 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:51,094 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-11 09:53:51,094 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:51,099 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-11 09:53:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:51,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:51,099 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-11 09:53:51,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:51,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:51,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:51,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:51,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-11 09:53:51,103 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-11 09:53:51,103 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:51,103 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:51,103 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,103 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:51,105 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,105 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:51,105 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:51,106 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,107 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,110 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-11 09:53:51,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:51,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-11 09:53:51,111 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:51,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:51,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:51,111 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:51,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:51,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:51,212 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:51,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:51,218 DEBUG [Listener at localhost/44465] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 09:53:51,220 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52342, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 09:53:51,222 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:51,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 09:53:51,236 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 09:53:51,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:53:51,238 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109831238 2023-02-11 09:53:51,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:53:51,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-11 09:53:51,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:51,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x4356ac02 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:53:51,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@700aa329, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:53:51,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,138 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ac79b00ce99a4b7e891af2e55759f991 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ac79b00ce99a4b7e891af2e55759f991 2023-02-11 09:53:52,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:52,158 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:53:52,159 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:53:52,171 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:53:52,173 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52350, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:53:52,207 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8c6a2504445d49988a687ef1ca48a916 first=Optional[r3] last=Optional[r6] 2023-02-11 09:53:52,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8c6a2504445d49988a687ef1ca48a916}] 2023-02-11 09:53:52,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8c6a2504445d49988a687ef1ca48a916 for inclusion in 3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:52,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 09:53:52,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:53:52,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:52,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8c6a2504445d49988a687ef1ca48a916 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__n13v97m730h0cvvmk8638spaa5vqt1stvi4g2vm6mdu9cee2srk57q4fctsvclo2/family1/8c6a2504445d49988a687ef1ca48a916 2023-02-11 09:53:52,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__n13v97m730h0cvvmk8638spaa5vqt1stvi4g2vm6mdu9cee2srk57q4fctsvclo2/family1/8c6a2504445d49988a687ef1ca48a916 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_ 2023-02-11 09:53:52,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__n13v97m730h0cvvmk8638spaa5vqt1stvi4g2vm6mdu9cee2srk57q4fctsvclo2/family1/8c6a2504445d49988a687ef1ca48a916 into 3f82f0c310b3fe5314afe7844ad07bca/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_ - updating store file list. 2023-02-11 09:53:52,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_ into 3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:52,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__n13v97m730h0cvvmk8638spaa5vqt1stvi4g2vm6mdu9cee2srk57q4fctsvclo2/family1/8c6a2504445d49988a687ef1ca48a916 into 3f82f0c310b3fe5314afe7844ad07bca/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_) 2023-02-11 09:53:52,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__n13v97m730h0cvvmk8638spaa5vqt1stvi4g2vm6mdu9cee2srk57q4fctsvclo2/family1/8c6a2504445d49988a687ef1ca48a916 2023-02-11 09:53:52,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 09:53:52,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 09:53:52,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 3f82f0c310b3fe5314afe7844ad07bca/family1 is initiating minor compaction 2023-02-11 09:53:52,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@40ced473; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:53:52,264 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3f82f0c310b3fe5314afe7844ad07bca/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:52,264 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/dd4b46e7981d420cb70f87e5d45f1b66, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/c155973832f34bd9957dd4f54e54c78a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/65bc2fe9676546fe868474db6b7ed73e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/545206fe4a8644c484f6a21f4f2b614b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/4e19dc7e88364ead80cfecf1c24f7396, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/19bc13a6a7cd4e298537f4c7617b193f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/9fa6601a43bd44ff8d7b635cb32aab46, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/17c8c98739ab4869b9f76c7ee808cbfe, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/5ea807fdb1d848f88917343727a1c61c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp, totalSize=50.2 K 2023-02-11 09:53:52,265 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting dd4b46e7981d420cb70f87e5d45f1b66, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:53:52,265 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c155973832f34bd9957dd4f54e54c78a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:53:52,265 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 65bc2fe9676546fe868474db6b7ed73e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 09:53:52,265 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 545206fe4a8644c484f6a21f4f2b614b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 09:53:52,266 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 4e19dc7e88364ead80cfecf1c24f7396, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 09:53:52,266 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 19bc13a6a7cd4e298537f4c7617b193f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 09:53:52,266 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 9fa6601a43bd44ff8d7b635cb32aab46, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 09:53:52,266 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 17c8c98739ab4869b9f76c7ee808cbfe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 09:53:52,266 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 5ea807fdb1d848f88917343727a1c61c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 09:53:52,266 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 09:53:52,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:52,281 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:53:52,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512284955cbfe0e104692854443b667f0dc7d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512284955cbfe0e104692854443b667f0dc7d 2023-02-11 09:53:52,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312fcafabd34bc45f68dc27e584d93884e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512312fcafabd34bc45f68dc27e584d93884e 2023-02-11 09:53:52,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601019648dc9e8ad643918b8f1d5c0adbe44f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601019648dc9e8ad643918b8f1d5c0adbe44f 2023-02-11 09:53:52,292 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103f416871440a14df9a3be200d6339c9ab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103f416871440a14df9a3be200d6339c9ab 2023-02-11 09:53:52,292 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-11 09:53:52,292 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 09:53:52,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,293 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,293 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,293 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,293 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,324 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3f82f0c310b3fe5314afe7844ad07bca#family1#compaction#10 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:53:52,782 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205396ba4b2c6434ccc9ee52e453c9e0236 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205396ba4b2c6434ccc9ee52e453c9e0236 2023-02-11 09:53:52,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:52,813 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b786e55112ec44fa885912943bb1da42 first=Optional[r00] last=Optional[r2] 2023-02-11 09:53:52,814 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b786e55112ec44fa885912943bb1da42}] 2023-02-11 09:53:52,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b786e55112ec44fa885912943bb1da42 for inclusion in 3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:52,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 09:53:52,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:53:52,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:52,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b786e55112ec44fa885912943bb1da42 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sbkdev8eg3i3dledt6nu387b4muhttmse64ubjn4fhfm9buq84q1s2upuu3meka7/family1/b786e55112ec44fa885912943bb1da42 2023-02-11 09:53:52,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sbkdev8eg3i3dledt6nu387b4muhttmse64ubjn4fhfm9buq84q1s2upuu3meka7/family1/b786e55112ec44fa885912943bb1da42 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_ 2023-02-11 09:53:52,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sbkdev8eg3i3dledt6nu387b4muhttmse64ubjn4fhfm9buq84q1s2upuu3meka7/family1/b786e55112ec44fa885912943bb1da42 into 3f82f0c310b3fe5314afe7844ad07bca/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_ - updating store file list. 2023-02-11 09:53:52,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_ into 3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:52,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sbkdev8eg3i3dledt6nu387b4muhttmse64ubjn4fhfm9buq84q1s2upuu3meka7/family1/b786e55112ec44fa885912943bb1da42 into 3f82f0c310b3fe5314afe7844ad07bca/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_) 2023-02-11 09:53:52,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sbkdev8eg3i3dledt6nu387b4muhttmse64ubjn4fhfm9buq84q1s2upuu3meka7/family1/b786e55112ec44fa885912943bb1da42 2023-02-11 09:53:52,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:52,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:53:52,836 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303d3b6adf48cd4b12bf00de3adba52d11 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303d3b6adf48cd4b12bf00de3adba52d11 2023-02-11 09:53:52,837 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120114b0f956c887442a99560993ba67613e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120114b0f956c887442a99560993ba67613e 2023-02-11 09:53:52,839 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205129e65d4313a4b4aaed5d2d390ba3442 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205129e65d4313a4b4aaed5d2d390ba3442 2023-02-11 09:53:52,839 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-11 09:53:52,839 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 09:53:52,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:52,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:52,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:53:52,841 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 09:53:52,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6130 sec 2023-02-11 09:53:52,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 09:53:52,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:53,150 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/08bf62c264474d779db9694088ce0110 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/08bf62c264474d779db9694088ce0110 2023-02-11 09:53:53,167 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3f82f0c310b3fe5314afe7844ad07bca/family1 of 3f82f0c310b3fe5314afe7844ad07bca into 08bf62c264474d779db9694088ce0110(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:53:53,167 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:53,168 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676109232262; duration=0sec 2023-02-11 09:53:53,170 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:53:53,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/dd4b46e7981d420cb70f87e5d45f1b66, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/c155973832f34bd9957dd4f54e54c78a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/65bc2fe9676546fe868474db6b7ed73e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/545206fe4a8644c484f6a21f4f2b614b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/4e19dc7e88364ead80cfecf1c24f7396, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/19bc13a6a7cd4e298537f4c7617b193f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/9fa6601a43bd44ff8d7b635cb32aab46, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/17c8c98739ab4869b9f76c7ee808cbfe, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/5ea807fdb1d848f88917343727a1c61c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_] to archive 2023-02-11 09:53:53,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:53:53,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/dd4b46e7981d420cb70f87e5d45f1b66 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/dd4b46e7981d420cb70f87e5d45f1b66 2023-02-11 09:53:53,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/c155973832f34bd9957dd4f54e54c78a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/c155973832f34bd9957dd4f54e54c78a 2023-02-11 09:53:53,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/65bc2fe9676546fe868474db6b7ed73e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/65bc2fe9676546fe868474db6b7ed73e 2023-02-11 09:53:53,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/545206fe4a8644c484f6a21f4f2b614b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/545206fe4a8644c484f6a21f4f2b614b 2023-02-11 09:53:53,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/4e19dc7e88364ead80cfecf1c24f7396 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/4e19dc7e88364ead80cfecf1c24f7396 2023-02-11 09:53:53,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/19bc13a6a7cd4e298537f4c7617b193f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/19bc13a6a7cd4e298537f4c7617b193f 2023-02-11 09:53:53,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/9fa6601a43bd44ff8d7b635cb32aab46 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/9fa6601a43bd44ff8d7b635cb32aab46 2023-02-11 09:53:53,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/17c8c98739ab4869b9f76c7ee808cbfe to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/17c8c98739ab4869b9f76c7ee808cbfe 2023-02-11 09:53:53,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/5ea807fdb1d848f88917343727a1c61c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/5ea807fdb1d848f88917343727a1c61c 2023-02-11 09:53:53,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/730ce5e4c1c04717b2e5236a9f3e8ec1_SeqId_44_ 2023-02-11 09:53:53,405 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-11 09:53:53,406 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-11 09:53:53,406 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-11 09:53:53,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-11 09:53:53,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, REOPEN/MOVE}] 2023-02-11 09:53:53,424 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, REOPEN/MOVE 2023-02-11 09:53:53,425 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f82f0c310b3fe5314afe7844ad07bca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:53,425 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676109233424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109233424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109233424"}]},"ts":"1676109233424"} 2023-02-11 09:53:53,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 3f82f0c310b3fe5314afe7844ad07bca, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:53:53,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f82f0c310b3fe5314afe7844ad07bca, disabling compactions & flushes 2023-02-11 09:53:53,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. after waiting 0 ms 2023-02-11 09:53:53,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-11 09:53:53,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f82f0c310b3fe5314afe7844ad07bca: Waiting for close lock at 1676109233586Running coprocessor pre-close hooks at 1676109233586Disabling compacts and flushes for region at 1676109233586Disabling writes for close at 1676109233586Writing region close event to WAL at 1676109233590 (+4 ms)Running coprocessor post-close hooks at 1676109233595 (+5 ms)Closed at 1676109233595 2023-02-11 09:53:53,595 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 3f82f0c310b3fe5314afe7844ad07bca to self. 2023-02-11 09:53:53,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,598 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f82f0c310b3fe5314afe7844ad07bca, regionState=CLOSED 2023-02-11 09:53:53,599 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676109233598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109233598"}]},"ts":"1676109233598"} 2023-02-11 09:53:53,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 09:53:53,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 3f82f0c310b3fe5314afe7844ad07bca, server=jenkins-hbase4.apache.org,43463,1676109215499 in 173 msec 2023-02-11 09:53:53,604 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=true 2023-02-11 09:53:53,754 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f82f0c310b3fe5314afe7844ad07bca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:53,755 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676109233754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109233754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109233754"}]},"ts":"1676109233754"} 2023-02-11 09:53:53,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 3f82f0c310b3fe5314afe7844ad07bca, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:53:53,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f82f0c310b3fe5314afe7844ad07bca, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:53:53,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:53,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,915 INFO [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,916 DEBUG [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:53,916 DEBUG [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:53,917 INFO [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f82f0c310b3fe5314afe7844ad07bca columnFamilyName family1 2023-02-11 09:53:53,925 DEBUG [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/08bf62c264474d779db9694088ce0110 2023-02-11 09:53:53,933 DEBUG [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/0b03cbb431dc42689fcafe5c1ef5abb3 2023-02-11 09:53:53,937 DEBUG [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_ 2023-02-11 09:53:53,938 INFO [StoreOpener-3f82f0c310b3fe5314afe7844ad07bca-1] regionserver.HStore(310): Store=3f82f0c310b3fe5314afe7844ad07bca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:53,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:53:53,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f82f0c310b3fe5314afe7844ad07bca; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71353317, jitterRate=0.06324727833271027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:53:53,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f82f0c310b3fe5314afe7844ad07bca: Running coprocessor pre-open hook at 1676109233914Writing region info on filesystem at 1676109233914Initializing all the Stores at 1676109233915 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676109233915Cleaning up temporary data from old regions at 1676109233940 (+25 ms)Cleaning up detritus from prior splits at 1676109233941 (+1 ms)Running coprocessor post-open hooks at 1676109233944 (+3 ms)Region opened successfully at 1676109233944 2023-02-11 09:53:53,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca., pid=17, masterSystemTime=1676109233910 2023-02-11 09:53:53,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:53:53,946 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 09:53:53,947 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 09:53:53,947 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1912): 3f82f0c310b3fe5314afe7844ad07bca/family1 is initiating minor compaction (all files) 2023-02-11 09:53:53,948 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3f82f0c310b3fe5314afe7844ad07bca/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,948 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/0b03cbb431dc42689fcafe5c1ef5abb3, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/08bf62c264474d779db9694088ce0110, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp, totalSize=358.6 K 2023-02-11 09:53:53,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:53:53,948 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 0b03cbb431dc42689fcafe5c1ef5abb3, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839484 2023-02-11 09:53:53,949 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3f82f0c310b3fe5314afe7844ad07bca, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:53,949 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 08bf62c264474d779db9694088ce0110, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239484 2023-02-11 09:53:53,949 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676109233948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109233948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109233948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109233948"}]},"ts":"1676109233948"} 2023-02-11 09:53:53,949 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878839484 2023-02-11 09:53:53,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-11 09:53:53,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 3f82f0c310b3fe5314afe7844ad07bca, server=jenkins-hbase4.apache.org,43463,1676109215499 in 194 msec 2023-02-11 09:53:53,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-11 09:53:53,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=3f82f0c310b3fe5314afe7844ad07bca, REOPEN/MOVE in 531 msec 2023-02-11 09:53:53,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-11 09:53:53,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 547 msec 2023-02-11 09:53:53,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 976 msec 2023-02-11 09:53:53,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-11 09:53:53,974 INFO [Listener at localhost/44465] compactions.TestMobCompactor(278): alter status finished 2023-02-11 09:53:53,975 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-11 09:53:53,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 09:53:53,984 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 09:53:53,987 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109833987 2023-02-11 09:53:53,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:53:53,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:53:53,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-11 09:53:53,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:53,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x0894bc7c to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:53:53,992 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3f82f0c310b3fe5314afe7844ad07bca#family1#compaction#11 average throughput is 5.16 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:53:54,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d97fe20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:53:54,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,005 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,428 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/.tmp/family1/c3cbb1a530af4c02a6c6055c111ee48f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/c3cbb1a530af4c02a6c6055c111ee48f 2023-02-11 09:53:54,436 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3f82f0c310b3fe5314afe7844ad07bca/family1 of 3f82f0c310b3fe5314afe7844ad07bca into c3cbb1a530af4c02a6c6055c111ee48f(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:53:54,436 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:54,436 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca., storeName=3f82f0c310b3fe5314afe7844ad07bca/family1, priority=13, startTime=1676109233945; duration=0sec 2023-02-11 09:53:54,436 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:53:54,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/0b03cbb431dc42689fcafe5c1ef5abb3, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/08bf62c264474d779db9694088ce0110, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_] to archive 2023-02-11 09:53:54,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:53:54,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/0b03cbb431dc42689fcafe5c1ef5abb3 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/0b03cbb431dc42689fcafe5c1ef5abb3 2023-02-11 09:53:54,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/08bf62c264474d779db9694088ce0110 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/08bf62c264474d779db9694088ce0110 2023-02-11 09:53:54,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/fcfdbda8ea9540258f79e8c247c78e63_SeqId_46_ 2023-02-11 09:53:54,846 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bcc4a4783add47f58cd6f3680952f6d7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128bcc4a4783add47f58cd6f3680952f6d7 2023-02-11 09:53:54,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:54,859 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:53:54,861 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:53:54,869 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:53:54,870 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:53:54,881 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9176dadda37b44b2b53b81a11644ced1 first=Optional[r05] last=Optional[r8] 2023-02-11 09:53:54,881 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=50 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9176dadda37b44b2b53b81a11644ced1}] 2023-02-11 09:53:54,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9176dadda37b44b2b53b81a11644ced1 for inclusion in 3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:54,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 09:53:54,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:53:54,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 3f82f0c310b3fe5314afe7844ad07bca: 2023-02-11 09:53:54,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9176dadda37b44b2b53b81a11644ced1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ptjltnntbuv14e6vjk6h3q709nins6boso34aa5t9e6d9atbgd3agur82pmcan/family1/9176dadda37b44b2b53b81a11644ced1 2023-02-11 09:53:54,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ptjltnntbuv14e6vjk6h3q709nins6boso34aa5t9e6d9atbgd3agur82pmcan/family1/9176dadda37b44b2b53b81a11644ced1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/d8aeebaf24c34f8f89b7b8205b2cadd6_SeqId_53_ 2023-02-11 09:53:54,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ptjltnntbuv14e6vjk6h3q709nins6boso34aa5t9e6d9atbgd3agur82pmcan/family1/9176dadda37b44b2b53b81a11644ced1 into 3f82f0c310b3fe5314afe7844ad07bca/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/d8aeebaf24c34f8f89b7b8205b2cadd6_SeqId_53_ - updating store file list. 2023-02-11 09:53:54,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/d8aeebaf24c34f8f89b7b8205b2cadd6_SeqId_53_ into 3f82f0c310b3fe5314afe7844ad07bca/family1 2023-02-11 09:53:54,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ptjltnntbuv14e6vjk6h3q709nins6boso34aa5t9e6d9atbgd3agur82pmcan/family1/9176dadda37b44b2b53b81a11644ced1 into 3f82f0c310b3fe5314afe7844ad07bca/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/family1/d8aeebaf24c34f8f89b7b8205b2cadd6_SeqId_53_) 2023-02-11 09:53:54,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2ptjltnntbuv14e6vjk6h3q709nins6boso34aa5t9e6d9atbgd3agur82pmcan/family1/9176dadda37b44b2b53b81a11644ced1 2023-02-11 09:53:54,901 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:54,902 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:53:54,904 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205f79a4e90d154ed9a071110cce9dfe5f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205f79a4e90d154ed9a071110cce9dfe5f 2023-02-11 09:53:54,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112899703fd280be4217866b62f6c6588281 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112899703fd280be4217866b62f6c6588281 2023-02-11 09:53:54,905 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-11 09:53:54,905 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 09:53:54,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-11 09:53:54,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-11 09:53:54,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:53:54,907 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-11 09:53:54,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 930 msec 2023-02-11 09:53:55,001 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 211) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34578 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:43463-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:46818 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6282de09-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34734 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d8eb786-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34684 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34690 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d8eb786-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x0894bc7c-SendThread(127.0.0.1:62294) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x6d8eb786-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x0894bc7c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x0894bc7c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/149561423.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34650 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6282de09-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34626 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:46812 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x4356ac02-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34634 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d8eb786-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d8eb786-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34746 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x4356ac02 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/149561423.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6282de09-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34604 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34718 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2045212924_15 at /127.0.0.1:34622 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x4356ac02-SendThread(127.0.0.1:62294) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:34654 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=586 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 286) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=3491 (was 3607) 2023-02-11 09:53:55,013 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=586, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=171, AvailableMemoryMB=3491 2023-02-11 09:53:55,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 09:53:55,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:55,018 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:53:55,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-11 09:53:55,019 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:53:55,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 09:53:55,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:55,021 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d empty. 2023-02-11 09:53:55,022 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:55,022 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-11 09:53:55,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 09:53:55,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 09:53:55,431 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 09:53:55,433 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => df6d5a64fc3bfc03d66e239964a4e80d, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:53:55,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 09:53:55,840 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:55,840 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing df6d5a64fc3bfc03d66e239964a4e80d, disabling compactions & flushes 2023-02-11 09:53:55,840 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:55,840 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:55,840 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. after waiting 0 ms 2023-02-11 09:53:55,840 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:55,841 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:55,841 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for df6d5a64fc3bfc03d66e239964a4e80d: Waiting for close lock at 1676109235840Disabling compacts and flushes for region at 1676109235840Disabling writes for close at 1676109235840Writing region close event to WAL at 1676109235841 (+1 ms)Closed at 1676109235841 2023-02-11 09:53:55,844 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:53:55,845 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676109235845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109235845"}]},"ts":"1676109235845"} 2023-02-11 09:53:55,847 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:53:55,849 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:53:55,849 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109235849"}]},"ts":"1676109235849"} 2023-02-11 09:53:55,851 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-11 09:53:55,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=df6d5a64fc3bfc03d66e239964a4e80d, ASSIGN}] 2023-02-11 09:53:55,856 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=df6d5a64fc3bfc03d66e239964a4e80d, ASSIGN 2023-02-11 09:53:55,860 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=df6d5a64fc3bfc03d66e239964a4e80d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:53:56,011 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=df6d5a64fc3bfc03d66e239964a4e80d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:56,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676109236011"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109236011"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109236011"}]},"ts":"1676109236011"} 2023-02-11 09:53:56,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure df6d5a64fc3bfc03d66e239964a4e80d, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:53:56,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 09:53:56,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:56,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => df6d5a64fc3bfc03d66e239964a4e80d, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:53:56,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:56,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:53:56,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:56,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:56,172 INFO [StoreOpener-df6d5a64fc3bfc03d66e239964a4e80d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:56,174 DEBUG [StoreOpener-df6d5a64fc3bfc03d66e239964a4e80d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:53:56,174 DEBUG [StoreOpener-df6d5a64fc3bfc03d66e239964a4e80d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:53:56,175 INFO [StoreOpener-df6d5a64fc3bfc03d66e239964a4e80d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df6d5a64fc3bfc03d66e239964a4e80d columnFamilyName family1 2023-02-11 09:53:56,176 INFO [StoreOpener-df6d5a64fc3bfc03d66e239964a4e80d-1] regionserver.HStore(310): Store=df6d5a64fc3bfc03d66e239964a4e80d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:53:56,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:56,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:56,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:53:56,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:53:56,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened df6d5a64fc3bfc03d66e239964a4e80d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59332176, jitterRate=-0.11588168144226074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:53:56,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for df6d5a64fc3bfc03d66e239964a4e80d: Running coprocessor pre-open hook at 1676109236171Writing region info on filesystem at 1676109236171Initializing all the Stores at 1676109236172 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676109236172Cleaning up temporary data from old regions at 1676109236178 (+6 ms)Cleaning up detritus from prior splits at 1676109236179 (+1 ms)Running coprocessor post-open hooks at 1676109236185 (+6 ms)Region opened successfully at 1676109236185 2023-02-11 09:53:56,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d., pid=21, masterSystemTime=1676109236166 2023-02-11 09:53:56,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:56,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:56,189 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=df6d5a64fc3bfc03d66e239964a4e80d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:56,189 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676109236188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109236188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109236188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109236188"}]},"ts":"1676109236188"} 2023-02-11 09:53:56,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-11 09:53:56,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure df6d5a64fc3bfc03d66e239964a4e80d, server=jenkins-hbase4.apache.org,43463,1676109215499 in 177 msec 2023-02-11 09:53:56,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-11 09:53:56,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=df6d5a64fc3bfc03d66e239964a4e80d, ASSIGN in 339 msec 2023-02-11 09:53:56,195 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:53:56,196 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109236195"}]},"ts":"1676109236195"} 2023-02-11 09:53:56,197 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-11 09:53:56,199 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:53:56,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1840 sec 2023-02-11 09:53:57,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-11 09:53:57,126 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-11 09:53:57,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:57,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,164 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:57,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:57,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:53:57,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:53:57,166 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,166 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,168 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,168 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:57,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:57,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:57,169 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,169 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:57,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:57,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:53:57,170 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:57,171 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:53:57,173 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:57,173 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:57,173 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:57,174 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:53:57,174 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 09:53:57,215 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a63f12d2bdcd4ba987eb4a9552316475 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a63f12d2bdcd4ba987eb4a9552316475 2023-02-11 09:53:57,219 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/d78fef9d2083424d86dc1406bed9c9ad 2023-02-11 09:53:57,225 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/d78fef9d2083424d86dc1406bed9c9ad as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/d78fef9d2083424d86dc1406bed9c9ad 2023-02-11 09:53:57,232 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/d78fef9d2083424d86dc1406bed9c9ad, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-11 09:53:57,234 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 60ms, sequenceid=5, compaction requested=false 2023-02-11 09:53:57,234 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:57,235 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:53:57,235 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:57,235 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:57,235 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:57,235 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,235 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:53:57,235 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:53:57,241 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,242 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:57,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:57,243 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:57,243 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:57,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:57,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:57,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:53:57,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ff0f211[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:57,244 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:53:57,245 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,246 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,246 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:53:57,246 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:53:57,246 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:57,246 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,246 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:57,248 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:53:57,248 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,248 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:57,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,248 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:53:57,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:57,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:57,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:57,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:57,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:57,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:57,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:53:57,252 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:53:57,252 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:57,252 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:57,252 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,252 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:57,254 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,255 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:57,255 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,255 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:57,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:57,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:57,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,257 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,259 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:57,259 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:57,260 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:57,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:57,260 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:57,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:57,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:57,260 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,261 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,261 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,261 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,261 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,261 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:57,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:57,261 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:57,261 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:57,361 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:57,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:57,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:57,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:57,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,369 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:57,369 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:57,370 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:53:57,370 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:53:57,371 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,371 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,372 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:57,372 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:57,372 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,372 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:57,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,373 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:53:57,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:53:57,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:57,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:53:57,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:57,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:57,374 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:57,374 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:53:57,374 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 09:53:57,396 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112810e7f061ad154f638f1c714888f4c46b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112810e7f061ad154f638f1c714888f4c46b 2023-02-11 09:53:57,803 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/b2abc0e7d6bf48e2b3d42cca0f11849b 2023-02-11 09:53:57,810 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/b2abc0e7d6bf48e2b3d42cca0f11849b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/b2abc0e7d6bf48e2b3d42cca0f11849b 2023-02-11 09:53:57,815 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/b2abc0e7d6bf48e2b3d42cca0f11849b, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 09:53:57,816 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 442ms, sequenceid=9, compaction requested=false 2023-02-11 09:53:57,817 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:53:57,817 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:57,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:57,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:57,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:53:57,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:53:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,819 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,819 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:57,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:57,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:53:57,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@206db8e5[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:57,821 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:53:57,821 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,822 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:53:57,822 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,822 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:53:57,822 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:53:57,825 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:57,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:57,825 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:53:57,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:57,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:53:57,829 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:53:57,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:57,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:57,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,829 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:57,831 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,831 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:57,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,831 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:57,831 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,838 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,843 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,843 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:57,843 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:57,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:57,843 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:57,843 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,844 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:57,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:57,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:57,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:57,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:53:57,849 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:57,849 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:57,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,949 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:57,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:57,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:57,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:57,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,966 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:57,966 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:57,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:53:57,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:53:57,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,969 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:57,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,969 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:57,969 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:57,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,970 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,970 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:53:57,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:53:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:57,971 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:53:57,972 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:57,972 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:57,972 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:57,972 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:53:57,972 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:58,388 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b247cf85d5c0459ea153d05b457030eb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b247cf85d5c0459ea153d05b457030eb 2023-02-11 09:53:58,830 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/77a42339c0fe4c268fed21c030616aa2 2023-02-11 09:53:58,838 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/77a42339c0fe4c268fed21c030616aa2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/77a42339c0fe4c268fed21c030616aa2 2023-02-11 09:53:58,844 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/77a42339c0fe4c268fed21c030616aa2, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 09:53:58,845 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 873ms, sequenceid=13, compaction requested=true 2023-02-11 09:53:58,845 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:53:58,845 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:58,846 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:58,846 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:58,846 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,846 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:53:58,846 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:53:58,848 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,848 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:58,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:58,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:58,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:58,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:58,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:58,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:53:58,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@618efe5f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:58,851 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:53:58,851 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,853 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,853 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:53:58,853 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:53:58,853 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:58,853 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,853 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:58,854 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,855 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:53:58,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:58,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:58,855 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:58,855 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:53:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:58,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:58,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:53:58,858 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:53:58,858 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:58,858 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:58,858 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,858 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:58,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:58,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:58,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:58,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:58,861 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,863 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:58,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:58,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:58,866 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:58,866 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:58,867 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,867 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:58,867 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:58,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:58,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:58,967 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:58,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:58,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:58,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:58,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,978 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:58,978 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:58,978 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:53:58,978 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:53:58,979 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,979 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,980 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,980 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:58,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:58,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:58,981 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:58,981 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:53:58,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:58,984 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:53:58,984 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:58,985 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:53:58,985 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:58,985 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:58,985 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:58,985 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:53:58,985 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:59,130 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:53:59,408 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ae203cc609c74cc8bfbc4f6e9530dd50 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ae203cc609c74cc8bfbc4f6e9530dd50 2023-02-11 09:53:59,816 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/36bab944503440a4bb6b41fa1c3ea5a3 2023-02-11 09:53:59,822 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/36bab944503440a4bb6b41fa1c3ea5a3 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/36bab944503440a4bb6b41fa1c3ea5a3 2023-02-11 09:53:59,827 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/36bab944503440a4bb6b41fa1c3ea5a3, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 09:53:59,828 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 843ms, sequenceid=17, compaction requested=true 2023-02-11 09:53:59,829 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:53:59,829 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:53:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:53:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:53:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:53:59,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,831 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:59,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:53:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:59,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:53:59,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18f0856a[Count = 0] remaining members to acquire global barrier 2023-02-11 09:53:59,833 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:53:59,833 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,834 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:53:59,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:53:59,834 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,834 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:53:59,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:53:59,836 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,836 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:53:59,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:59,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:53:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:53:59,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:53:59,840 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:53:59,840 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:53:59,840 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:53:59,840 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,840 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:53:59,842 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,842 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:53:59,842 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:59,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:53:59,842 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:53:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,844 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:53:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,846 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,847 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,847 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:59,847 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:59,847 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:53:59,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:59,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:53:59,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:59,847 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,847 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:53:59,847 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,848 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,848 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,848 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:53:59,848 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:53:59,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:53:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:53:59,948 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:53:59,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:53:59,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:53:59,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:53:59,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,960 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:53:59,960 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:59,960 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:53:59,960 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:53:59,961 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,961 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,962 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:53:59,962 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:53:59,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:53:59,963 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:53:59,963 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:53:59,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:53:59,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,964 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,966 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:53:59,966 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:53:59,966 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:53:59,966 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:53:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:53:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:53:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:53:59,967 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:53:59,967 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:53:59,967 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:53:59,983 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228978bb47d6d3344c99619835f485eebbb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228978bb47d6d3344c99619835f485eebbb 2023-02-11 09:54:00,392 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/c759fd4715474c20930700a8e589ccc7 2023-02-11 09:54:00,398 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/c759fd4715474c20930700a8e589ccc7 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/c759fd4715474c20930700a8e589ccc7 2023-02-11 09:54:00,403 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/c759fd4715474c20930700a8e589ccc7, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 09:54:00,404 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 437ms, sequenceid=21, compaction requested=true 2023-02-11 09:54:00,404 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:00,404 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:54:00,404 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:54:00,406 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,406 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:00,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:00,406 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,406 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:00,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:54:00,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30b89c1f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:00,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:00,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,410 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,410 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:00,410 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:54:00,410 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:00,410 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,410 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:00,412 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,412 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:54:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:00,412 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:00,413 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:54:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:00,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:00,416 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:54:00,416 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:00,416 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:00,416 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,416 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:00,425 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,425 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:00,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,425 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:00,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:00,426 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,427 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,429 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:00,429 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:00,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:54:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:00,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:00,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:00,429 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:00,429 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,429 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:00,430 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:00,430 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:00,430 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,431 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:00,431 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,431 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,431 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,531 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:00,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:00,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:00,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:00,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,539 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:00,539 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:00,540 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:54:00,540 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:00,540 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,540 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,542 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,542 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:00,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:00,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:00,542 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:00,542 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:00,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:00,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,543 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:54:00,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:00,544 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:54:00,544 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:00,544 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:54:00,548 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:00,548 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:00,548 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:00,548 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:54:00,548 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:00,967 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a7187d01cbaf4309b7db3bc92b05935e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a7187d01cbaf4309b7db3bc92b05935e 2023-02-11 09:54:01,374 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/72e6598b2f284919a873810ce644c4ad 2023-02-11 09:54:01,381 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/72e6598b2f284919a873810ce644c4ad as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/72e6598b2f284919a873810ce644c4ad 2023-02-11 09:54:01,386 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/72e6598b2f284919a873810ce644c4ad, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 09:54:01,387 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 839ms, sequenceid=25, compaction requested=true 2023-02-11 09:54:01,387 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:01,387 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:54:01,387 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:54:01,389 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,389 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:01,389 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,389 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:01,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:54:01,391 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:01,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ddfa07d[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:01,391 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,392 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:01,392 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:54:01,392 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,392 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:01,392 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:01,394 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,394 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:54:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:01,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:01,394 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:01,394 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:54:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:01,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:01,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:01,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:01,397 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:54:01,397 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:01,397 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:01,397 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,397 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:01,400 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,400 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:01,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,400 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:01,401 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:01,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:01,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:01,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,402 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:01,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:01,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:01,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:01,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,409 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:01,410 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:01,410 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:01,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:01,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:54:01,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:01,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:01,510 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:01,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:01,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:01,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:01,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,518 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:01,518 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:01,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:54:01,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:01,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,521 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,521 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:01,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:01,521 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,521 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,522 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,522 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:54:01,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,522 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:54:01,523 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:01,523 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:54:01,523 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:01,523 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:01,523 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:01,523 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:54:01,523 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:01,539 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c5758bb950be46b7868a0c38f2e2a80c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c5758bb950be46b7868a0c38f2e2a80c 2023-02-11 09:54:01,945 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/4192e9cc1cfd4798a63a49e49817bc0f 2023-02-11 09:54:01,951 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/4192e9cc1cfd4798a63a49e49817bc0f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/4192e9cc1cfd4798a63a49e49817bc0f 2023-02-11 09:54:01,957 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/4192e9cc1cfd4798a63a49e49817bc0f, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 09:54:01,958 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 435ms, sequenceid=29, compaction requested=true 2023-02-11 09:54:01,959 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:01,959 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:54:01,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:54:01,961 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,961 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:01,961 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,961 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:01,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:54:01,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bb5c59f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:01,963 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:01,963 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,964 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,964 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:01,964 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:54:01,964 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,964 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:01,964 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:01,967 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:54:01,967 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,967 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:01,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:01,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:01,967 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:54:01,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:01,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:01,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:01,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:01,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:01,970 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:54:01,971 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:01,971 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:01,971 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,971 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:01,972 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,972 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,972 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:01,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:01,973 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:01,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:01,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,975 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,977 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,977 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:01,977 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:01,977 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:01,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:54:01,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:01,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:01,977 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:01,977 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:01,978 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:01,978 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,979 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,979 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:01,979 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:01,979 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:02,079 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:02,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:02,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:02,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:02,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,088 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:02,088 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:02,089 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:54:02,089 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:02,089 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,089 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,090 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:02,090 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:02,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:02,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,091 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,091 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:02,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:02,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,092 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,092 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:54:02,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,092 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:54:02,092 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:02,092 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:54:02,093 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:02,093 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:02,093 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:02,093 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:54:02,093 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:02,510 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031a968bc3fba94759aa839c15db408517 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601031a968bc3fba94759aa839c15db408517 2023-02-11 09:54:02,917 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/a1b5243eab834804be594884670548ab 2023-02-11 09:54:02,924 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/a1b5243eab834804be594884670548ab as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/a1b5243eab834804be594884670548ab 2023-02-11 09:54:02,929 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/a1b5243eab834804be594884670548ab, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 09:54:02,930 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 837ms, sequenceid=33, compaction requested=true 2023-02-11 09:54:02,930 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:02,930 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:54:02,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:54:02,932 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,932 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:02,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:02,933 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,933 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:02,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:02,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:02,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:54:02,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77f2d656[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:02,935 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:02,935 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,936 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:54:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:02,936 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,936 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:02,941 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:54:02,941 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,942 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:02,942 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:02,945 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:54:02,945 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:02,945 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:02,946 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,946 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:02,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:02,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:02,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:02,948 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:02,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,949 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:02,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:02,952 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:02,955 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:02,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:02,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:02,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:54:02,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:02,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:02,952 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:02,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:02,956 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:02,957 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:03,057 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:03,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:03,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:03,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:03,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,066 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:03,067 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:03,067 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:54:03,067 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:03,067 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,067 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,069 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,069 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:03,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:03,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:03,069 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,069 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:03,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:03,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,070 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,071 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:54:03,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,071 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:54:03,071 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:03,071 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:54:03,071 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:03,071 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:03,071 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:03,071 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:54:03,071 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:03,488 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f1da8c6b70484a029a4f321c140ef48b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907f1da8c6b70484a029a4f321c140ef48b 2023-02-11 09:54:03,895 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/7a704dde7a0548e7a370331dc73f80d8 2023-02-11 09:54:03,901 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/7a704dde7a0548e7a370331dc73f80d8 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/7a704dde7a0548e7a370331dc73f80d8 2023-02-11 09:54:03,906 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/7a704dde7a0548e7a370331dc73f80d8, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 09:54:03,907 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 836ms, sequenceid=37, compaction requested=true 2023-02-11 09:54:03,907 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:03,907 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:03,907 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:03,907 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:03,907 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,907 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:54:03,907 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:54:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,909 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:03,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,909 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:03,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:03,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:54:03,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35ee4d3[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:03,911 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:03,911 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,912 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,912 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:03,912 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:54:03,912 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:03,912 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,912 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:03,914 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:54:03,914 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:03,914 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,915 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:54:03,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:03,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:03,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:03,918 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:54:03,918 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:03,918 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:03,918 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,918 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:03,920 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,920 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:03,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,920 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:03,920 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,921 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,923 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,923 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:03,924 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:03,924 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:03,924 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:03,924 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:03,924 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:03,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:54:03,924 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:03,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:03,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:03,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:03,925 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,925 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:03,925 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:03,925 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:04,025 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:04,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:04,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:04,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:04,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,033 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:04,033 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:04,034 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:54:04,034 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:04,034 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,034 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,036 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:04,036 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:04,036 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,036 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,037 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:54:04,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:54:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:04,039 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:54:04,039 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:04,039 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:04,039 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:04,039 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. started... 2023-02-11 09:54:04,039 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df6d5a64fc3bfc03d66e239964a4e80d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:04,455 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120808017b756b5435e9417e941f5f7a5b5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120808017b756b5435e9417e941f5f7a5b5 2023-02-11 09:54:04,861 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/22a1e2ab42a441f9b0f01b812f382fcf 2023-02-11 09:54:04,868 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/22a1e2ab42a441f9b0f01b812f382fcf as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/22a1e2ab42a441f9b0f01b812f382fcf 2023-02-11 09:54:04,872 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/22a1e2ab42a441f9b0f01b812f382fcf, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 09:54:04,873 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for df6d5a64fc3bfc03d66e239964a4e80d in 834ms, sequenceid=41, compaction requested=true 2023-02-11 09:54:04,873 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:04,873 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:04,873 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:04,873 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:04,873 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,873 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:54:04,873 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:54:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,875 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:04,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:04,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:04,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:54:04,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@382608d[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:04,877 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:04,877 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,879 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,879 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:04,879 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:54:04,879 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:04,879 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,879 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:04,881 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,881 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:54:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:04,881 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:04,881 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:54:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:04,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:04,884 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:54:04,884 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:04,884 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:04,884 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,884 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:04,886 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,886 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:04,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,886 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:04,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:04,886 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:04,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,888 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:04,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,890 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:04,890 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:04,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:04,890 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:04,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-11 09:54:04,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:04,890 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:04,890 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:04,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:04,892 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:04,892 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,892 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:04,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:04,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,993 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:04,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:04,995 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-11 09:54:04,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:04,998 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:04,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:04,999 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109844999 2023-02-11 09:54:05,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:54:05,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-11 09:54:05,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:05,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x2f45ed8d to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:54:05,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dc170bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:54:05,007 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:05,858 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033060f512794342b6b9ea2bbb1cb16dd1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033060f512794342b6b9ea2bbb1cb16dd1 2023-02-11 09:54:05,859 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:05,872 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:54:05,873 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42762, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:54:05,880 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:54:05,882 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37644, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:54:05,894 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/64df30374f4c47bc86cf56143a3b19e0 first=Optional[r5] last=Optional[r6] 2023-02-11 09:54:05,895 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/64df30374f4c47bc86cf56143a3b19e0}] 2023-02-11 09:54:05,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/64df30374f4c47bc86cf56143a3b19e0 for inclusion in df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:54:05,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-11 09:54:05,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:05,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:05,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/64df30374f4c47bc86cf56143a3b19e0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uqfdo34s54k10ik0fhp9mtcm99t9nsg6tbiehp4r68ftgffg4lqn8flodrj3pabk/family1/64df30374f4c47bc86cf56143a3b19e0 2023-02-11 09:54:05,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uqfdo34s54k10ik0fhp9mtcm99t9nsg6tbiehp4r68ftgffg4lqn8flodrj3pabk/family1/64df30374f4c47bc86cf56143a3b19e0 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_ 2023-02-11 09:54:05,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uqfdo34s54k10ik0fhp9mtcm99t9nsg6tbiehp4r68ftgffg4lqn8flodrj3pabk/family1/64df30374f4c47bc86cf56143a3b19e0 into df6d5a64fc3bfc03d66e239964a4e80d/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_ - updating store file list. 2023-02-11 09:54:05,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_ into df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:54:05,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uqfdo34s54k10ik0fhp9mtcm99t9nsg6tbiehp4r68ftgffg4lqn8flodrj3pabk/family1/64df30374f4c47bc86cf56143a3b19e0 into df6d5a64fc3bfc03d66e239964a4e80d/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_) 2023-02-11 09:54:05,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uqfdo34s54k10ik0fhp9mtcm99t9nsg6tbiehp4r68ftgffg4lqn8flodrj3pabk/family1/64df30374f4c47bc86cf56143a3b19e0 2023-02-11 09:54:05,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 09:54:05,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 09:54:05,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): df6d5a64fc3bfc03d66e239964a4e80d/family1 is initiating minor compaction 2023-02-11 09:54:05,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@64dccd6b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:05,917 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of df6d5a64fc3bfc03d66e239964a4e80d/family1 in testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:05,918 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/b2abc0e7d6bf48e2b3d42cca0f11849b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/77a42339c0fe4c268fed21c030616aa2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/36bab944503440a4bb6b41fa1c3ea5a3, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/c759fd4715474c20930700a8e589ccc7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/72e6598b2f284919a873810ce644c4ad, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/4192e9cc1cfd4798a63a49e49817bc0f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/a1b5243eab834804be594884670548ab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/7a704dde7a0548e7a370331dc73f80d8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/22a1e2ab42a441f9b0f01b812f382fcf, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp, totalSize=49.7 K 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting b2abc0e7d6bf48e2b3d42cca0f11849b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 77a42339c0fe4c268fed21c030616aa2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 36bab944503440a4bb6b41fa1c3ea5a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c759fd4715474c20930700a8e589ccc7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 72e6598b2f284919a873810ce644c4ad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 4192e9cc1cfd4798a63a49e49817bc0f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting a1b5243eab834804be594884670548ab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 7a704dde7a0548e7a370331dc73f80d8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 22a1e2ab42a441f9b0f01b812f382fcf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 09:54:05,918 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 634764d4272d4b4daa5660146ec78833_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 09:54:05,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:05,920 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:05,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c5758bb950be46b7868a0c38f2e2a80c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101c5758bb950be46b7868a0c38f2e2a80c 2023-02-11 09:54:05,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601031a968bc3fba94759aa839c15db408517 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601031a968bc3fba94759aa839c15db408517 2023-02-11 09:54:05,924 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-11 09:54:05,924 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-11 09:54:05,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:05,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:05,989 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): df6d5a64fc3bfc03d66e239964a4e80d#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:06,807 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a77ca555c4294243a3f6e09dee17f2fe to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a77ca555c4294243a3f6e09dee17f2fe 2023-02-11 09:54:06,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:06,813 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/ff5fd5b3953c4728bdb35eef414ff77a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/ff5fd5b3953c4728bdb35eef414ff77a 2023-02-11 09:54:06,819 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in df6d5a64fc3bfc03d66e239964a4e80d/family1 of df6d5a64fc3bfc03d66e239964a4e80d into ff5fd5b3953c4728bdb35eef414ff77a(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:54:06,819 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:06,820 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676109245917; duration=0sec 2023-02-11 09:54:06,820 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:06,833 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/557ee3acedd84e8184df9509741d4949 first=Optional[r1] last=Optional[r4] 2023-02-11 09:54:06,834 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/557ee3acedd84e8184df9509741d4949}] 2023-02-11 09:54:06,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/557ee3acedd84e8184df9509741d4949 for inclusion in df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:54:06,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-11 09:54:06,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:06,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:06,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/557ee3acedd84e8184df9509741d4949 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__5d39kk4ossuleue47efpqri2fa1vdgld3922eh4svbbs46716j58mqu2r5h1jlk6/family1/557ee3acedd84e8184df9509741d4949 2023-02-11 09:54:06,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__5d39kk4ossuleue47efpqri2fa1vdgld3922eh4svbbs46716j58mqu2r5h1jlk6/family1/557ee3acedd84e8184df9509741d4949 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_ 2023-02-11 09:54:06,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__5d39kk4ossuleue47efpqri2fa1vdgld3922eh4svbbs46716j58mqu2r5h1jlk6/family1/557ee3acedd84e8184df9509741d4949 into df6d5a64fc3bfc03d66e239964a4e80d/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_ - updating store file list. 2023-02-11 09:54:06,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/b2abc0e7d6bf48e2b3d42cca0f11849b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/77a42339c0fe4c268fed21c030616aa2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/36bab944503440a4bb6b41fa1c3ea5a3, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/c759fd4715474c20930700a8e589ccc7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/72e6598b2f284919a873810ce644c4ad, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/4192e9cc1cfd4798a63a49e49817bc0f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/a1b5243eab834804be594884670548ab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/7a704dde7a0548e7a370331dc73f80d8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/22a1e2ab42a441f9b0f01b812f382fcf, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_] to archive 2023-02-11 09:54:06,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_ into df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:54:06,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__5d39kk4ossuleue47efpqri2fa1vdgld3922eh4svbbs46716j58mqu2r5h1jlk6/family1/557ee3acedd84e8184df9509741d4949 into df6d5a64fc3bfc03d66e239964a4e80d/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_) 2023-02-11 09:54:06,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:06,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__5d39kk4ossuleue47efpqri2fa1vdgld3922eh4svbbs46716j58mqu2r5h1jlk6/family1/557ee3acedd84e8184df9509741d4949 2023-02-11 09:54:06,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 09:54:06,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 09:54:06,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): df6d5a64fc3bfc03d66e239964a4e80d/family1 is initiating minor compaction (all files) 2023-02-11 09:54:06,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7e8f5342; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:06,855 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of df6d5a64fc3bfc03d66e239964a4e80d/family1 in testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:54:06,855 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/d78fef9d2083424d86dc1406bed9c9ad, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/ff5fd5b3953c4728bdb35eef414ff77a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp, totalSize=178.1 K 2023-02-11 09:54:06,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/b2abc0e7d6bf48e2b3d42cca0f11849b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/b2abc0e7d6bf48e2b3d42cca0f11849b 2023-02-11 09:54:06,856 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting d78fef9d2083424d86dc1406bed9c9ad, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839484 2023-02-11 09:54:06,856 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting ff5fd5b3953c4728bdb35eef414ff77a, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239484 2023-02-11 09:54:06,857 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965239484 2023-02-11 09:54:06,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/77a42339c0fe4c268fed21c030616aa2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/77a42339c0fe4c268fed21c030616aa2 2023-02-11 09:54:06,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/36bab944503440a4bb6b41fa1c3ea5a3 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/36bab944503440a4bb6b41fa1c3ea5a3 2023-02-11 09:54:06,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/c759fd4715474c20930700a8e589ccc7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/c759fd4715474c20930700a8e589ccc7 2023-02-11 09:54:06,866 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:06,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/72e6598b2f284919a873810ce644c4ad to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/72e6598b2f284919a873810ce644c4ad 2023-02-11 09:54:06,868 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:06,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/4192e9cc1cfd4798a63a49e49817bc0f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/4192e9cc1cfd4798a63a49e49817bc0f 2023-02-11 09:54:06,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/a1b5243eab834804be594884670548ab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/a1b5243eab834804be594884670548ab 2023-02-11 09:54:06,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/7a704dde7a0548e7a370331dc73f80d8 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/7a704dde7a0548e7a370331dc73f80d8 2023-02-11 09:54:06,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/22a1e2ab42a441f9b0f01b812f382fcf to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/22a1e2ab42a441f9b0f01b812f382fcf 2023-02-11 09:54:06,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/634764d4272d4b4daa5660146ec78833_SeqId_44_ 2023-02-11 09:54:06,885 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b247cf85d5c0459ea153d05b457030eb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b247cf85d5c0459ea153d05b457030eb 2023-02-11 09:54:06,889 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ae203cc609c74cc8bfbc4f6e9530dd50 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ae203cc609c74cc8bfbc4f6e9530dd50 2023-02-11 09:54:06,892 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228978bb47d6d3344c99619835f485eebbb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228978bb47d6d3344c99619835f485eebbb 2023-02-11 09:54:06,892 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): df6d5a64fc3bfc03d66e239964a4e80d#family1#compaction#23 average throughput is 9.73 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:06,894 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a7187d01cbaf4309b7db3bc92b05935e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a7187d01cbaf4309b7db3bc92b05935e 2023-02-11 09:54:06,894 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-11 09:54:06,894 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-11 09:54:06,895 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:06,895 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:07,722 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/.tmp/family1/d910a9decc2e448593321d67b05b8952 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/d910a9decc2e448593321d67b05b8952 2023-02-11 09:54:07,732 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in df6d5a64fc3bfc03d66e239964a4e80d/family1 of df6d5a64fc3bfc03d66e239964a4e80d into d910a9decc2e448593321d67b05b8952(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:54:07,732 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:07,732 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676109246855; duration=0sec 2023-02-11 09:54:07,732 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:07,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/d78fef9d2083424d86dc1406bed9c9ad, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/ff5fd5b3953c4728bdb35eef414ff77a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_] to archive 2023-02-11 09:54:07,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:07,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/d78fef9d2083424d86dc1406bed9c9ad to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/d78fef9d2083424d86dc1406bed9c9ad 2023-02-11 09:54:07,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/ff5fd5b3953c4728bdb35eef414ff77a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/ff5fd5b3953c4728bdb35eef414ff77a 2023-02-11 09:54:07,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/2adf9c5ca6404b31ad8b77f2df6834ad_SeqId_47_ 2023-02-11 09:54:07,791 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113088b3ac114cc3411a9762870ab2e3949a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113088b3ac114cc3411a9762870ab2e3949a 2023-02-11 09:54:07,794 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:07,824 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3eebb9ed3fd4d9090b803c8d305c75a first=Optional[r00] last=Optional[r8] 2023-02-11 09:54:07,825 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3eebb9ed3fd4d9090b803c8d305c75a}] 2023-02-11 09:54:07,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3eebb9ed3fd4d9090b803c8d305c75a for inclusion in df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:54:07,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-11 09:54:07,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:07,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for df6d5a64fc3bfc03d66e239964a4e80d: 2023-02-11 09:54:07,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3eebb9ed3fd4d9090b803c8d305c75a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm0tfkmcicmrk540qu0jiq9s2ivg09mjtin008dvp99oi4r8o3ulp67o649ra7lq/family1/d3eebb9ed3fd4d9090b803c8d305c75a 2023-02-11 09:54:07,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm0tfkmcicmrk540qu0jiq9s2ivg09mjtin008dvp99oi4r8o3ulp67o649ra7lq/family1/d3eebb9ed3fd4d9090b803c8d305c75a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/8d687523d2c5480b914e526f58929b66_SeqId_50_ 2023-02-11 09:54:07,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm0tfkmcicmrk540qu0jiq9s2ivg09mjtin008dvp99oi4r8o3ulp67o649ra7lq/family1/d3eebb9ed3fd4d9090b803c8d305c75a into df6d5a64fc3bfc03d66e239964a4e80d/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/8d687523d2c5480b914e526f58929b66_SeqId_50_ - updating store file list. 2023-02-11 09:54:07,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/8d687523d2c5480b914e526f58929b66_SeqId_50_ into df6d5a64fc3bfc03d66e239964a4e80d/family1 2023-02-11 09:54:07,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm0tfkmcicmrk540qu0jiq9s2ivg09mjtin008dvp99oi4r8o3ulp67o649ra7lq/family1/d3eebb9ed3fd4d9090b803c8d305c75a into df6d5a64fc3bfc03d66e239964a4e80d/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/family1/8d687523d2c5480b914e526f58929b66_SeqId_50_) 2023-02-11 09:54:07,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bm0tfkmcicmrk540qu0jiq9s2ivg09mjtin008dvp99oi4r8o3ulp67o649ra7lq/family1/d3eebb9ed3fd4d9090b803c8d305c75a 2023-02-11 09:54:07,849 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:07,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:07,851 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120808017b756b5435e9417e941f5f7a5b5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120808017b756b5435e9417e941f5f7a5b5 2023-02-11 09:54:07,853 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112810e7f061ad154f638f1c714888f4c46b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112810e7f061ad154f638f1c714888f4c46b 2023-02-11 09:54:07,854 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a63f12d2bdcd4ba987eb4a9552316475 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130a63f12d2bdcd4ba987eb4a9552316475 2023-02-11 09:54:07,855 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-11 09:54:07,855 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 09:54:07,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:07,855 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:07,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:54:07,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:54:07,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:07,857 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:07,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.8610 sec 2023-02-11 09:54:08,034 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=255 (was 252) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57174 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x2f45ed8d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x39478d9c-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57228 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39478d9c-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57242 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57248 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57182 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57250 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2045212924_15 at /127.0.0.1:57270 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x2f45ed8d-SendThread(127.0.0.1:62294) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x39478d9c-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57184 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57148 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39478d9c-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57118 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57224 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:47054 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57294 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39478d9c-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62294@0x2f45ed8d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/149561423.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2045212924_15 at /127.0.0.1:57344 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-26267040_15 at /127.0.0.1:57288 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39478d9c-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39478d9c-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=605 (was 586) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=314 (was 308) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 171), AvailableMemoryMB=3054 (was 3491) 2023-02-11 09:54:08,053 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=605, MaxFileDescriptor=60000, SystemLoadAverage=314, ProcessCount=169, AvailableMemoryMB=3053 2023-02-11 09:54:08,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 09:54:08,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,060 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:54:08,061 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:54:08,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-11 09:54:08,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 09:54:08,064 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,065 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f empty. 2023-02-11 09:54:08,065 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,066 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-11 09:54:08,079 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 09:54:08,081 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => e473f47fdbb8d1df882d5c22130ea71f, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:54:08,098 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:08,098 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing e473f47fdbb8d1df882d5c22130ea71f, disabling compactions & flushes 2023-02-11 09:54:08,098 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,098 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,098 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. after waiting 0 ms 2023-02-11 09:54:08,098 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,098 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,099 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for e473f47fdbb8d1df882d5c22130ea71f: Waiting for close lock at 1676109248098Disabling compacts and flushes for region at 1676109248098Disabling writes for close at 1676109248098Writing region close event to WAL at 1676109248098Closed at 1676109248098 2023-02-11 09:54:08,102 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:54:08,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676109248103"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109248103"}]},"ts":"1676109248103"} 2023-02-11 09:54:08,106 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:54:08,108 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:54:08,108 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109248108"}]},"ts":"1676109248108"} 2023-02-11 09:54:08,111 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-11 09:54:08,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e473f47fdbb8d1df882d5c22130ea71f, ASSIGN}] 2023-02-11 09:54:08,122 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e473f47fdbb8d1df882d5c22130ea71f, ASSIGN 2023-02-11 09:54:08,123 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e473f47fdbb8d1df882d5c22130ea71f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:54:08,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 09:54:08,274 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e473f47fdbb8d1df882d5c22130ea71f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:08,275 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676109248274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109248274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109248274"}]},"ts":"1676109248274"} 2023-02-11 09:54:08,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure e473f47fdbb8d1df882d5c22130ea71f, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:08,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 09:54:08,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e473f47fdbb8d1df882d5c22130ea71f, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:54:08,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:08,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,434 INFO [StoreOpener-e473f47fdbb8d1df882d5c22130ea71f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,436 DEBUG [StoreOpener-e473f47fdbb8d1df882d5c22130ea71f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1 2023-02-11 09:54:08,436 DEBUG [StoreOpener-e473f47fdbb8d1df882d5c22130ea71f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1 2023-02-11 09:54:08,436 INFO [StoreOpener-e473f47fdbb8d1df882d5c22130ea71f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e473f47fdbb8d1df882d5c22130ea71f columnFamilyName family1 2023-02-11 09:54:08,438 INFO [StoreOpener-e473f47fdbb8d1df882d5c22130ea71f-1] regionserver.HStore(310): Store=e473f47fdbb8d1df882d5c22130ea71f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:08,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:54:08,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:54:08,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e473f47fdbb8d1df882d5c22130ea71f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74722477, jitterRate=0.11345167458057404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:54:08,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e473f47fdbb8d1df882d5c22130ea71f: Running coprocessor pre-open hook at 1676109248433Writing region info on filesystem at 1676109248433Initializing all the Stores at 1676109248434 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676109248434Cleaning up temporary data from old regions at 1676109248440 (+6 ms)Cleaning up detritus from prior splits at 1676109248440Running coprocessor post-open hooks at 1676109248445 (+5 ms)Region opened successfully at 1676109248445 2023-02-11 09:54:08,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f., pid=25, masterSystemTime=1676109248429 2023-02-11 09:54:08,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,448 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e473f47fdbb8d1df882d5c22130ea71f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:08,448 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676109248448"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109248448"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109248448"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109248448"}]},"ts":"1676109248448"} 2023-02-11 09:54:08,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-11 09:54:08,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure e473f47fdbb8d1df882d5c22130ea71f, server=jenkins-hbase4.apache.org,43463,1676109215499 in 173 msec 2023-02-11 09:54:08,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-11 09:54:08,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e473f47fdbb8d1df882d5c22130ea71f, ASSIGN in 333 msec 2023-02-11 09:54:08,455 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:54:08,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109248455"}]},"ts":"1676109248455"} 2023-02-11 09:54:08,456 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-11 09:54:08,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:54:08,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 402 msec 2023-02-11 09:54:08,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-11 09:54:08,668 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-11 09:54:08,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:08,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,696 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:08,696 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:08,696 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:08,696 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:08,696 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,697 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,698 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:08,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:08,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:08,698 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:08,698 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:08,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:08,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,699 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:08,699 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:08,708 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:08,708 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:08,708 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:08,708 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:08,709 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 09:54:09,140 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113065773d1998934458a220e5097bdd808e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113065773d1998934458a220e5097bdd808e 2023-02-11 09:54:09,143 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/d202738d4af54f92ae507a62b9833c97 2023-02-11 09:54:09,148 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/d202738d4af54f92ae507a62b9833c97 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/d202738d4af54f92ae507a62b9833c97 2023-02-11 09:54:09,153 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/d202738d4af54f92ae507a62b9833c97, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-11 09:54:09,154 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 445ms, sequenceid=5, compaction requested=false 2023-02-11 09:54:09,154 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:09,155 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:09,155 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:09,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:09,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:09,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:09,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:09,157 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,157 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:09,157 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,158 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:09,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:09,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@465ed45f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:09,159 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:09,159 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,160 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,160 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:09,160 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:09,160 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,160 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:09,160 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:09,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:09,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:09,162 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:09,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:09,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:09,164 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:09,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:09,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:09,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,165 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:09,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:09,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:09,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,167 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:09,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:09,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:09,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:09,172 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:09,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,174 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:09,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:09,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:09,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:09,176 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:09,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:09,177 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,177 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,277 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:09,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:09,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:09,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:09,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,284 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:09,284 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:09,284 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:09,284 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:09,284 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,284 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,285 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,285 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:09,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:09,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:09,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:09,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:09,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,287 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:09,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:09,287 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:09,287 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:09,287 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:09,287 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 09:54:09,701 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281d7ddb2e1e624a1286e3f768a77d663d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511281d7ddb2e1e624a1286e3f768a77d663d 2023-02-11 09:54:10,106 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/4f86e260320c44fa90c8813a715c0f88 2023-02-11 09:54:10,112 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/4f86e260320c44fa90c8813a715c0f88 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/4f86e260320c44fa90c8813a715c0f88 2023-02-11 09:54:10,116 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/4f86e260320c44fa90c8813a715c0f88, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 09:54:10,117 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 830ms, sequenceid=9, compaction requested=false 2023-02-11 09:54:10,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:10,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:10,117 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:10,117 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:10,117 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:10,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:10,119 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,119 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:10,119 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,119 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:10,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:10,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:10,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:10,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27ffeaa4[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:10,121 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:10,121 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,122 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,122 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:10,122 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:10,122 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,122 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:10,122 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:10,125 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:10,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:10,125 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:10,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:10,127 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:10,127 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:10,127 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:10,127 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,127 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:10,129 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,129 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:10,129 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:10,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:10,129 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:10,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,130 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,133 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:10,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:10,133 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:10,134 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:10,234 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:10,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:10,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:10,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:10,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,241 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:10,241 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:10,241 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:10,241 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:10,242 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,242 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,243 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:10,243 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:10,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,244 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,244 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:10,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,244 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,245 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:10,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,245 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:10,245 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:10,245 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:10,245 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:10,245 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:10,245 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:10,245 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:10,245 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:10,660 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018e366e00ff1b4251ac013ca0b2ee335f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512018e366e00ff1b4251ac013ca0b2ee335f 2023-02-11 09:54:10,667 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/565e3b131aa3463a95e69067b3d43d77 2023-02-11 09:54:10,673 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/565e3b131aa3463a95e69067b3d43d77 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/565e3b131aa3463a95e69067b3d43d77 2023-02-11 09:54:10,678 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/565e3b131aa3463a95e69067b3d43d77, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 09:54:10,680 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 435ms, sequenceid=13, compaction requested=true 2023-02-11 09:54:10,680 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:10,680 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:10,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:10,682 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,682 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:10,682 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,682 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:10,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:10,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53f3eaf4[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:10,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:10,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,685 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,685 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:10,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:10,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:10,686 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,686 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:10,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:10,687 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:10,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:10,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:10,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:10,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:10,689 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:10,689 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:10,689 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:10,689 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,689 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:10,691 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,691 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:10,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,691 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:10,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:10,692 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:10,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,693 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:10,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,698 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:10,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:10,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:10,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:10,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:10,699 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:10,698 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:10,699 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,699 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:10,699 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:10,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:10,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:10,799 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:10,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:10,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:10,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:10,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,806 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:10,806 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:10,807 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:10,807 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:10,807 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,807 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,808 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,808 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:10,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:10,808 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:10,808 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,809 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,810 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:10,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:10,810 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:10,810 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:10,810 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:10,810 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:11,223 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205692d1f5fc5224b74b1ab0b364f2fc441 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205692d1f5fc5224b74b1ab0b364f2fc441 2023-02-11 09:54:11,629 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/1f687f902efe4c8f9b90137e124c1741 2023-02-11 09:54:11,635 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/1f687f902efe4c8f9b90137e124c1741 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1f687f902efe4c8f9b90137e124c1741 2023-02-11 09:54:11,639 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1f687f902efe4c8f9b90137e124c1741, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 09:54:11,640 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 830ms, sequenceid=17, compaction requested=true 2023-02-11 09:54:11,641 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:11,641 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:11,642 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,642 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:11,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:11,643 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,643 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:11,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:11,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:11,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:11,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:11,644 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:11,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e56e0f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:11,644 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,646 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,647 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:11,647 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:11,647 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,647 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:11,647 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:11,648 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:11,648 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:11,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:11,651 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:11,651 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:11,651 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:11,651 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,651 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:11,652 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,652 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:11,652 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:11,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:11,653 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:11,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,654 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,656 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:11,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:11,656 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:11,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:11,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:11,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:11,657 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:11,657 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:11,757 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:11,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:11,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:11,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:11,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,764 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:11,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:11,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:11,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:11,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:11,767 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:11,767 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,767 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:11,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,768 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,768 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:11,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:11,768 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:11,768 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:11,768 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:11,769 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:11,769 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:11,769 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:11,769 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:11,769 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:12,182 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c20777ba14664f4f8b967a52141dda51 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c20777ba14664f4f8b967a52141dda51 2023-02-11 09:54:12,588 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/13508c7884d74396b610d0b619ac7bef 2023-02-11 09:54:12,593 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/13508c7884d74396b610d0b619ac7bef as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/13508c7884d74396b610d0b619ac7bef 2023-02-11 09:54:12,598 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/13508c7884d74396b610d0b619ac7bef, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 09:54:12,599 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 830ms, sequenceid=21, compaction requested=true 2023-02-11 09:54:12,600 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:12,600 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:12,601 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,601 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:12,602 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,602 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:12,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:12,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7329a600[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:12,603 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:12,603 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,605 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,605 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:12,605 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:12,605 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:12,605 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,606 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:12,607 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,607 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:12,607 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:12,607 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:12,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:12,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:12,609 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:12,609 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:12,609 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:12,609 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,609 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:12,612 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,612 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:12,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,612 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:12,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:12,612 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,613 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:12,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:12,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:12,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,616 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:12,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,616 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,716 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:12,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:12,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:12,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:12,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,723 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:12,723 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:12,723 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:12,723 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:12,723 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,723 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,725 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,725 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:12,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:12,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:12,725 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:12,725 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:12,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:12,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,726 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:12,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:12,726 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:12,726 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:12,726 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:13,139 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313cd6c71597924464b029f7bb43223310 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512313cd6c71597924464b029f7bb43223310 2023-02-11 09:54:13,545 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/a6351fe8e15e4714a746c8777f954b49 2023-02-11 09:54:13,550 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/a6351fe8e15e4714a746c8777f954b49 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/a6351fe8e15e4714a746c8777f954b49 2023-02-11 09:54:13,554 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/a6351fe8e15e4714a746c8777f954b49, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 09:54:13,555 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 829ms, sequenceid=25, compaction requested=true 2023-02-11 09:54:13,556 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:13,556 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:13,556 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:13,556 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:13,556 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,556 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:13,556 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:13,557 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,557 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:13,558 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,558 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:13,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b5bd80b[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:13,559 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:13,560 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,562 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,562 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:13,562 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:13,562 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,562 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:13,562 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:13,564 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:13,564 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,564 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:13,564 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:13,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:13,566 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:13,566 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:13,566 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:13,566 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,566 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:13,571 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,571 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,571 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:13,571 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,572 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:13,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:13,575 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:13,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:13,575 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:13,576 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,684 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:13,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:13,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:13,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:13,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,704 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:13,704 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:13,704 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:13,704 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:13,707 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,707 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,709 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:13,709 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:13,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:13,710 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,710 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:13,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,711 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,711 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:13,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,711 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:13,711 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:13,711 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:13,712 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:13,712 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:13,712 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:13,712 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:13,712 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:13,738 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010138db24e6072140ff8cbe93a19b0cff00 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010138db24e6072140ff8cbe93a19b0cff00 2023-02-11 09:54:13,745 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/372d5fd51575414a953fa5ae2b33baae 2023-02-11 09:54:13,752 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/372d5fd51575414a953fa5ae2b33baae as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/372d5fd51575414a953fa5ae2b33baae 2023-02-11 09:54:13,758 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/372d5fd51575414a953fa5ae2b33baae, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 09:54:13,759 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 47ms, sequenceid=29, compaction requested=true 2023-02-11 09:54:13,759 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:13,759 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:13,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:13,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:13,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:13,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:13,761 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,761 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:13,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:13,761 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,761 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:13,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:13,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673333de[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:13,763 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:13,763 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,765 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,765 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:13,765 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:13,765 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:13,765 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,765 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:13,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,767 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:13,767 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:13,767 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:13,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:13,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:13,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:13,770 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:13,770 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:13,770 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:13,770 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,770 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:13,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:13,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:13,774 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:13,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,775 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,780 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:13,780 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:13,780 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:13,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:13,780 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:13,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:13,780 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,780 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:13,780 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,780 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,781 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,781 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,781 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:13,781 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:13,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:13,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:13,881 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:13,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:13,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:13,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:13,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,888 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:13,888 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:13,888 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:13,888 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:13,888 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,888 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,890 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:13,890 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:13,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:13,891 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:13,891 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:13,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:13,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,892 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,892 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:13,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:13,892 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:13,892 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:13,892 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:13,892 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:13,892 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:13,892 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:13,892 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:13,893 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:13,963 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:54:14,307 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fb26395c091b4a1ba1c5e222ea55e8ba to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb26395c091b4a1ba1c5e222ea55e8ba 2023-02-11 09:54:14,312 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/71806c608a1b4831872e9b9f6293704d 2023-02-11 09:54:14,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/71806c608a1b4831872e9b9f6293704d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/71806c608a1b4831872e9b9f6293704d 2023-02-11 09:54:14,322 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/71806c608a1b4831872e9b9f6293704d, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 09:54:14,323 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 430ms, sequenceid=33, compaction requested=true 2023-02-11 09:54:14,323 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:14,323 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:14,323 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:14,323 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:14,323 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,323 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:14,323 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:14,325 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,325 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:14,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:14,326 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,326 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:14,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:14,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:14,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:14,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:14,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f4eac21[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:14,327 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:14,327 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,328 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,328 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:14,329 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:14,329 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:14,329 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,329 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:14,330 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,330 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:14,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:14,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:14,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:14,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:14,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:14,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:14,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:14,332 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:14,332 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:14,332 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:14,332 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,332 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:14,335 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,335 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:14,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,335 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:14,335 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:14,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:14,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,336 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,338 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,338 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:14,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:14,339 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:14,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:14,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,440 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:14,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:14,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:14,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:14,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,447 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:14,447 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:14,447 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:14,447 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:14,447 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,447 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,449 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:14,449 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:14,449 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:14,449 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:14,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:14,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,450 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,450 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:14,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:14,450 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:14,450 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:14,450 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:14,450 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:14,451 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:14,451 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:14,451 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:14,451 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:14,864 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073d6becef45ec446698ad5384b6f0f427 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509073d6becef45ec446698ad5384b6f0f427 2023-02-11 09:54:15,270 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/e0fe3c7e3e1e4055bdd963e9c726259c 2023-02-11 09:54:15,276 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/e0fe3c7e3e1e4055bdd963e9c726259c as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e0fe3c7e3e1e4055bdd963e9c726259c 2023-02-11 09:54:15,281 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e0fe3c7e3e1e4055bdd963e9c726259c, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 09:54:15,282 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 831ms, sequenceid=37, compaction requested=true 2023-02-11 09:54:15,282 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:15,282 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:15,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,284 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:15,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:15,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31e9126e[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:15,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:15,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,290 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:15,290 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,290 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:15,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:15,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:15,293 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:15,293 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,293 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:15,293 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:15,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:15,295 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:15,295 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:15,295 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:15,295 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,295 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:15,297 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,297 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:15,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,297 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:15,297 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,298 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:15,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,300 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:15,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:15,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:15,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:15,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:15,301 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,301 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,302 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,401 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:15,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:15,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:15,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:15,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,408 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:15,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:15,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:15,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:15,409 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,409 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,410 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:15,410 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:15,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:15,410 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,410 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:15,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:15,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,411 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,411 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:15,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,411 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:15,411 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:15,412 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:15,412 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:15,412 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:15,412 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:15,412 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. started... 2023-02-11 09:54:15,412 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e473f47fdbb8d1df882d5c22130ea71f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:15,426 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206e78fa898fb945769a425c5a1d46e27d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511206e78fa898fb945769a425c5a1d46e27d 2023-02-11 09:54:15,432 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/1ce69f22dc3d43598b117632cea47e3b 2023-02-11 09:54:15,437 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/1ce69f22dc3d43598b117632cea47e3b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1ce69f22dc3d43598b117632cea47e3b 2023-02-11 09:54:15,442 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1ce69f22dc3d43598b117632cea47e3b, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 09:54:15,443 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e473f47fdbb8d1df882d5c22130ea71f in 31ms, sequenceid=41, compaction requested=true 2023-02-11 09:54:15,443 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:15,443 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:15,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:15,446 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,446 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:15,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:15,446 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,447 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:15,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:15,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44871fd8[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:15,448 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:15,448 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,449 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,449 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:15,450 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,450 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:15,451 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,451 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:15,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:15,451 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:15,451 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:15,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:15,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:15,454 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:15,454 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:15,454 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:15,454 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,454 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:15,456 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,456 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:15,456 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:15,456 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:15,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:15,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,457 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:15,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:15,461 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:15,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:15,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-11 09:54:15,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:15,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,461 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,462 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,462 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:15,462 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:15,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:15,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:15,562 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:15,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:15,564 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-11 09:54:15,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:15,567 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:15,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:15,568 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109855568 2023-02-11 09:54:15,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 09:54:15,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-11 09:54:15,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:15,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x31f502df to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:54:15,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7777f8f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:54:15,576 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,432 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f4a3eac971ec48c98e11488bcfab84c8 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103f4a3eac971ec48c98e11488bcfab84c8 2023-02-11 09:54:16,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:16,447 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:54:16,448 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:54:16,454 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:54:16,456 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:54:16,467 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f0fd925cc1e84c69b847b34cfe65e8d6 first=Optional[r3] last=Optional[r6] 2023-02-11 09:54:16,467 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f0fd925cc1e84c69b847b34cfe65e8d6}] 2023-02-11 09:54:16,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f0fd925cc1e84c69b847b34cfe65e8d6 for inclusion in e473f47fdbb8d1df882d5c22130ea71f/family1 2023-02-11 09:54:16,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 09:54:16,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:16,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:16,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f0fd925cc1e84c69b847b34cfe65e8d6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ljt5d5alstonmepiifugrtsvg83gqgp57q1pr8e674l0kjdqh7ql3lnomhucgtdm/family1/f0fd925cc1e84c69b847b34cfe65e8d6 2023-02-11 09:54:16,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ljt5d5alstonmepiifugrtsvg83gqgp57q1pr8e674l0kjdqh7ql3lnomhucgtdm/family1/f0fd925cc1e84c69b847b34cfe65e8d6 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_ 2023-02-11 09:54:16,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ljt5d5alstonmepiifugrtsvg83gqgp57q1pr8e674l0kjdqh7ql3lnomhucgtdm/family1/f0fd925cc1e84c69b847b34cfe65e8d6 into e473f47fdbb8d1df882d5c22130ea71f/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_ - updating store file list. 2023-02-11 09:54:16,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_ into e473f47fdbb8d1df882d5c22130ea71f/family1 2023-02-11 09:54:16,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ljt5d5alstonmepiifugrtsvg83gqgp57q1pr8e674l0kjdqh7ql3lnomhucgtdm/family1/f0fd925cc1e84c69b847b34cfe65e8d6 into e473f47fdbb8d1df882d5c22130ea71f/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_) 2023-02-11 09:54:16,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ljt5d5alstonmepiifugrtsvg83gqgp57q1pr8e674l0kjdqh7ql3lnomhucgtdm/family1/f0fd925cc1e84c69b847b34cfe65e8d6 2023-02-11 09:54:16,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 09:54:16,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 09:54:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): e473f47fdbb8d1df882d5c22130ea71f/family1 is initiating minor compaction 2023-02-11 09:54:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5024e1b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:16,486 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e473f47fdbb8d1df882d5c22130ea71f/family1 in testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:16,486 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/4f86e260320c44fa90c8813a715c0f88, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/565e3b131aa3463a95e69067b3d43d77, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1f687f902efe4c8f9b90137e124c1741, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/13508c7884d74396b610d0b619ac7bef, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/a6351fe8e15e4714a746c8777f954b49, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/372d5fd51575414a953fa5ae2b33baae, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/71806c608a1b4831872e9b9f6293704d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e0fe3c7e3e1e4055bdd963e9c726259c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1ce69f22dc3d43598b117632cea47e3b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp, totalSize=50.0 K 2023-02-11 09:54:16,486 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 4f86e260320c44fa90c8813a715c0f88, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:54:16,486 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 565e3b131aa3463a95e69067b3d43d77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:54:16,486 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 1f687f902efe4c8f9b90137e124c1741, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 09:54:16,486 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 13508c7884d74396b610d0b619ac7bef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 09:54:16,486 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting a6351fe8e15e4714a746c8777f954b49, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 09:54:16,487 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 372d5fd51575414a953fa5ae2b33baae, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 09:54:16,487 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 71806c608a1b4831872e9b9f6293704d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 09:54:16,487 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting e0fe3c7e3e1e4055bdd963e9c726259c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 09:54:16,487 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 1ce69f22dc3d43598b117632cea47e3b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 09:54:16,487 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 09:54:16,488 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:16,489 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:16,490 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c20777ba14664f4f8b967a52141dda51 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c20777ba14664f4f8b967a52141dda51 2023-02-11 09:54:16,492 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512313cd6c71597924464b029f7bb43223310 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512313cd6c71597924464b029f7bb43223310 2023-02-11 09:54:16,494 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010138db24e6072140ff8cbe93a19b0cff00 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010138db24e6072140ff8cbe93a19b0cff00 2023-02-11 09:54:16,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb26395c091b4a1ba1c5e222ea55e8ba to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb26395c091b4a1ba1c5e222ea55e8ba 2023-02-11 09:54:16,495 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-11 09:54:16,495 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 09:54:16,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:16,517 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): e473f47fdbb8d1df882d5c22130ea71f#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:16,931 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052eef0e01140145579cdc164d80c602ac to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052eef0e01140145579cdc164d80c602ac 2023-02-11 09:54:16,933 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/e94bf8af426c4af1ba4742b5678a131e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e94bf8af426c4af1ba4742b5678a131e 2023-02-11 09:54:16,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:16,940 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e473f47fdbb8d1df882d5c22130ea71f/family1 of e473f47fdbb8d1df882d5c22130ea71f into e94bf8af426c4af1ba4742b5678a131e(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:54:16,940 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:16,941 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676109256485; duration=0sec 2023-02-11 09:54:16,941 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:16,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/4f86e260320c44fa90c8813a715c0f88, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/565e3b131aa3463a95e69067b3d43d77, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1f687f902efe4c8f9b90137e124c1741, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/13508c7884d74396b610d0b619ac7bef, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/a6351fe8e15e4714a746c8777f954b49, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/372d5fd51575414a953fa5ae2b33baae, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/71806c608a1b4831872e9b9f6293704d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e0fe3c7e3e1e4055bdd963e9c726259c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1ce69f22dc3d43598b117632cea47e3b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_] to archive 2023-02-11 09:54:16,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:16,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/4f86e260320c44fa90c8813a715c0f88 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/4f86e260320c44fa90c8813a715c0f88 2023-02-11 09:54:16,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/565e3b131aa3463a95e69067b3d43d77 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/565e3b131aa3463a95e69067b3d43d77 2023-02-11 09:54:16,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1f687f902efe4c8f9b90137e124c1741 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1f687f902efe4c8f9b90137e124c1741 2023-02-11 09:54:16,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/13508c7884d74396b610d0b619ac7bef to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/13508c7884d74396b610d0b619ac7bef 2023-02-11 09:54:16,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/a6351fe8e15e4714a746c8777f954b49 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/a6351fe8e15e4714a746c8777f954b49 2023-02-11 09:54:16,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/372d5fd51575414a953fa5ae2b33baae to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/372d5fd51575414a953fa5ae2b33baae 2023-02-11 09:54:16,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/71806c608a1b4831872e9b9f6293704d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/71806c608a1b4831872e9b9f6293704d 2023-02-11 09:54:16,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e0fe3c7e3e1e4055bdd963e9c726259c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e0fe3c7e3e1e4055bdd963e9c726259c 2023-02-11 09:54:16,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1ce69f22dc3d43598b117632cea47e3b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/1ce69f22dc3d43598b117632cea47e3b 2023-02-11 09:54:16,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/2a7edeb2cae5464a80b3dd53846b69f9_SeqId_44_ 2023-02-11 09:54:16,991 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 first=Optional[r1] last=Optional[r2] 2023-02-11 09:54:16,992 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/412f7c9caab64527a3e4ef5fb4a1b8d7}] 2023-02-11 09:54:16,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 for inclusion in e473f47fdbb8d1df882d5c22130ea71f/family1 2023-02-11 09:54:16,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-11 09:54:16,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:16,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:17,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__92vtfsftjkgi4s9u8knm6h0endva2juen9bh2s2ud7jvddm93eroaa7cgi2fbjbf/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 2023-02-11 09:54:17,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__92vtfsftjkgi4s9u8knm6h0endva2juen9bh2s2ud7jvddm93eroaa7cgi2fbjbf/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_ 2023-02-11 09:54:17,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__92vtfsftjkgi4s9u8knm6h0endva2juen9bh2s2ud7jvddm93eroaa7cgi2fbjbf/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 into e473f47fdbb8d1df882d5c22130ea71f/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_ - updating store file list. 2023-02-11 09:54:17,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_ into e473f47fdbb8d1df882d5c22130ea71f/family1 2023-02-11 09:54:17,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__92vtfsftjkgi4s9u8knm6h0endva2juen9bh2s2ud7jvddm93eroaa7cgi2fbjbf/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 into e473f47fdbb8d1df882d5c22130ea71f/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_) 2023-02-11 09:54:17,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithWeeklyPolicy__92vtfsftjkgi4s9u8knm6h0endva2juen9bh2s2ud7jvddm93eroaa7cgi2fbjbf/family1/412f7c9caab64527a3e4ef5fb4a1b8d7 2023-02-11 09:54:17,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 09:54:17,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 09:54:17,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): e473f47fdbb8d1df882d5c22130ea71f/family1 is initiating minor compaction (all files) 2023-02-11 09:54:17,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9c0ffc1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:17,015 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e473f47fdbb8d1df882d5c22130ea71f/family1 in testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:54:17,015 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/d202738d4af54f92ae507a62b9833c97, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e94bf8af426c4af1ba4742b5678a131e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp, totalSize=176.8 K 2023-02-11 09:54:17,016 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting d202738d4af54f92ae507a62b9833c97, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839484 2023-02-11 09:54:17,016 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting e94bf8af426c4af1ba4742b5678a131e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239484 2023-02-11 09:54:17,017 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting f58002f5f67741598811e0c72c3f9554_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965239484 2023-02-11 09:54:17,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:17,023 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:17,025 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512018e366e00ff1b4251ac013ca0b2ee335f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512018e366e00ff1b4251ac013ca0b2ee335f 2023-02-11 09:54:17,033 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205692d1f5fc5224b74b1ab0b364f2fc441 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205692d1f5fc5224b74b1ab0b364f2fc441 2023-02-11 09:54:17,033 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-11 09:54:17,033 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 09:54:17,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:17,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:17,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:17,035 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:17,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4700 sec 2023-02-11 09:54:17,049 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): e473f47fdbb8d1df882d5c22130ea71f#family1#compaction#35 average throughput is 11.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:17,113 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:17,114 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31f502df to 127.0.0.1:62294 2023-02-11 09:54:17,114 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:17,118 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:17,118 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f45ed8d to 127.0.0.1:62294 2023-02-11 09:54:17,118 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:17,122 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:17,122 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0894bc7c to 127.0.0.1:62294 2023-02-11 09:54:17,122 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:17,123 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:17,123 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4356ac02 to 127.0.0.1:62294 2023-02-11 09:54:17,123 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:17,174 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=260 (was 255) - Thread LEAK? -, OpenFileDescriptor=605 (was 605), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 314), ProcessCount=169 (was 169), AvailableMemoryMB=2824 (was 3053) 2023-02-11 09:54:17,189 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260, OpenFileDescriptor=605, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=169, AvailableMemoryMB=2822 2023-02-11 09:54:17,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 09:54:17,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:17,195 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:54:17,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-11 09:54:17,196 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:54:17,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 09:54:17,198 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:17,199 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:17,199 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:17,199 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae empty. 2023-02-11 09:54:17,199 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f empty. 2023-02-11 09:54:17,200 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:17,200 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8 empty. 2023-02-11 09:54:17,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:17,200 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:17,200 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-11 09:54:17,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 09:54:17,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 09:54:17,620 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-11 09:54:17,622 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 673673bfe0aa18b892e937412149ace8, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:54:17,622 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => fdf5a340462b75ac8dcb6a5d2682295f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:54:17,622 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => da22992fcdb8645f6d18a6b22b1a57ae, NAME => 'testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:54:17,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing fdf5a340462b75ac8dcb6a5d2682295f, disabling compactions & flushes 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:18,065 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 673673bfe0aa18b892e937412149ace8, disabling compactions & flushes 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:18,065 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. after waiting 0 ms 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. after waiting 0 ms 2023-02-11 09:54:18,065 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 673673bfe0aa18b892e937412149ace8: Waiting for close lock at 1676109258065Disabling compacts and flushes for region at 1676109258065Disabling writes for close at 1676109258065Writing region close event to WAL at 1676109258065Closed at 1676109258065 2023-02-11 09:54:18,065 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:18,065 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for fdf5a340462b75ac8dcb6a5d2682295f: Waiting for close lock at 1676109258065Disabling compacts and flushes for region at 1676109258065Disabling writes for close at 1676109258065Writing region close event to WAL at 1676109258065Closed at 1676109258065 2023-02-11 09:54:18,066 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:18,066 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing da22992fcdb8645f6d18a6b22b1a57ae, disabling compactions & flushes 2023-02-11 09:54:18,066 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:18,066 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:18,066 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. after waiting 0 ms 2023-02-11 09:54:18,066 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:18,066 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:18,066 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for da22992fcdb8645f6d18a6b22b1a57ae: Waiting for close lock at 1676109258066Disabling compacts and flushes for region at 1676109258066Disabling writes for close at 1676109258066Writing region close event to WAL at 1676109258066Closed at 1676109258066 2023-02-11 09:54:18,069 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:54:18,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676109258069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109258069"}]},"ts":"1676109258069"} 2023-02-11 09:54:18,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676109258069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109258069"}]},"ts":"1676109258069"} 2023-02-11 09:54:18,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676109258069"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109258069"}]},"ts":"1676109258069"} 2023-02-11 09:54:18,072 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 09:54:18,073 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:54:18,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109258073"}]},"ts":"1676109258073"} 2023-02-11 09:54:18,074 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-11 09:54:18,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=da22992fcdb8645f6d18a6b22b1a57ae, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fdf5a340462b75ac8dcb6a5d2682295f, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=673673bfe0aa18b892e937412149ace8, ASSIGN}] 2023-02-11 09:54:18,081 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fdf5a340462b75ac8dcb6a5d2682295f, ASSIGN 2023-02-11 09:54:18,081 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=da22992fcdb8645f6d18a6b22b1a57ae, ASSIGN 2023-02-11 09:54:18,081 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=673673bfe0aa18b892e937412149ace8, ASSIGN 2023-02-11 09:54:18,081 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=da22992fcdb8645f6d18a6b22b1a57ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:54:18,081 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fdf5a340462b75ac8dcb6a5d2682295f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:54:18,081 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=673673bfe0aa18b892e937412149ace8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:54:18,233 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fdf5a340462b75ac8dcb6a5d2682295f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:18,233 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=673673bfe0aa18b892e937412149ace8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:18,233 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=da22992fcdb8645f6d18a6b22b1a57ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:18,233 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676109258233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109258233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109258233"}]},"ts":"1676109258233"} 2023-02-11 09:54:18,233 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676109258233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109258233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109258233"}]},"ts":"1676109258233"} 2023-02-11 09:54:18,233 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676109258233"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109258233"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109258233"}]},"ts":"1676109258233"} 2023-02-11 09:54:18,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure fdf5a340462b75ac8dcb6a5d2682295f, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:18,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 673673bfe0aa18b892e937412149ace8, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:18,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure da22992fcdb8645f6d18a6b22b1a57ae, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:18,284 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/.tmp/family1/36ef77b19e5e43d5a15738bc0e711c7c as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/36ef77b19e5e43d5a15738bc0e711c7c 2023-02-11 09:54:18,290 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in e473f47fdbb8d1df882d5c22130ea71f/family1 of e473f47fdbb8d1df882d5c22130ea71f into 36ef77b19e5e43d5a15738bc0e711c7c(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:54:18,290 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e473f47fdbb8d1df882d5c22130ea71f: 2023-02-11 09:54:18,290 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676109257014; duration=1sec 2023-02-11 09:54:18,290 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:18,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 09:54:18,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/d202738d4af54f92ae507a62b9833c97, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e94bf8af426c4af1ba4742b5678a131e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_] to archive 2023-02-11 09:54:18,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:18,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/d202738d4af54f92ae507a62b9833c97 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/d202738d4af54f92ae507a62b9833c97 2023-02-11 09:54:18,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e94bf8af426c4af1ba4742b5678a131e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/e94bf8af426c4af1ba4742b5678a131e 2023-02-11 09:54:18,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/family1/f58002f5f67741598811e0c72c3f9554_SeqId_47_ 2023-02-11 09:54:18,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:18,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fdf5a340462b75ac8dcb6a5d2682295f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 09:54:18,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:18,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,392 INFO [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,393 DEBUG [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f/family1 2023-02-11 09:54:18,393 DEBUG [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f/family1 2023-02-11 09:54:18,393 INFO [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdf5a340462b75ac8dcb6a5d2682295f columnFamilyName family1 2023-02-11 09:54:18,395 INFO [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] regionserver.HStore(310): Store=fdf5a340462b75ac8dcb6a5d2682295f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:18,395 INFO [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,396 DEBUG [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f/family2 2023-02-11 09:54:18,396 DEBUG [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f/family2 2023-02-11 09:54:18,396 INFO [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdf5a340462b75ac8dcb6a5d2682295f columnFamilyName family2 2023-02-11 09:54:18,398 INFO [StoreOpener-fdf5a340462b75ac8dcb6a5d2682295f-1] regionserver.HStore(310): Store=fdf5a340462b75ac8dcb6a5d2682295f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:18,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:54:18,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:54:18,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:54:18,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fdf5a340462b75ac8dcb6a5d2682295f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59000989, jitterRate=-0.12081675231456757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:54:18,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fdf5a340462b75ac8dcb6a5d2682295f: Running coprocessor pre-open hook at 1676109258390Writing region info on filesystem at 1676109258390Initializing all the Stores at 1676109258391 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109258391Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109258391Cleaning up temporary data from old regions at 1676109258399 (+8 ms)Cleaning up detritus from prior splits at 1676109258399Running coprocessor post-open hooks at 1676109258403 (+4 ms)Region opened successfully at 1676109258403 2023-02-11 09:54:18,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f., pid=31, masterSystemTime=1676109258387 2023-02-11 09:54:18,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:18,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:18,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:18,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 673673bfe0aa18b892e937412149ace8, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 09:54:18,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,406 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=fdf5a340462b75ac8dcb6a5d2682295f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:18,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:18,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,406 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676109258405"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109258405"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109258405"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109258405"}]},"ts":"1676109258405"} 2023-02-11 09:54:18,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,407 INFO [StoreOpener-673673bfe0aa18b892e937412149ace8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,408 DEBUG [StoreOpener-673673bfe0aa18b892e937412149ace8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1 2023-02-11 09:54:18,408 DEBUG [StoreOpener-673673bfe0aa18b892e937412149ace8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1 2023-02-11 09:54:18,409 INFO [StoreOpener-673673bfe0aa18b892e937412149ace8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 673673bfe0aa18b892e937412149ace8 columnFamilyName family1 2023-02-11 09:54:18,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-11 09:54:18,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure fdf5a340462b75ac8dcb6a5d2682295f, server=jenkins-hbase4.apache.org,43463,1676109215499 in 172 msec 2023-02-11 09:54:18,409 INFO [StoreOpener-673673bfe0aa18b892e937412149ace8-1] regionserver.HStore(310): Store=673673bfe0aa18b892e937412149ace8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:18,410 INFO [StoreOpener-673673bfe0aa18b892e937412149ace8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fdf5a340462b75ac8dcb6a5d2682295f, ASSIGN in 330 msec 2023-02-11 09:54:18,411 DEBUG [StoreOpener-673673bfe0aa18b892e937412149ace8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family2 2023-02-11 09:54:18,411 DEBUG [StoreOpener-673673bfe0aa18b892e937412149ace8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family2 2023-02-11 09:54:18,412 INFO [StoreOpener-673673bfe0aa18b892e937412149ace8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 673673bfe0aa18b892e937412149ace8 columnFamilyName family2 2023-02-11 09:54:18,413 INFO [StoreOpener-673673bfe0aa18b892e937412149ace8-1] regionserver.HStore(310): Store=673673bfe0aa18b892e937412149ace8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:18,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:54:18,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 673673bfe0aa18b892e937412149ace8 2023-02-11 09:54:18,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:54:18,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 673673bfe0aa18b892e937412149ace8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61280987, jitterRate=-0.0868421345949173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:54:18,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 673673bfe0aa18b892e937412149ace8: Running coprocessor pre-open hook at 1676109258406Writing region info on filesystem at 1676109258406Initializing all the Stores at 1676109258407 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109258407Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109258407Cleaning up temporary data from old regions at 1676109258414 (+7 ms)Cleaning up detritus from prior splits at 1676109258415 (+1 ms)Running coprocessor post-open hooks at 1676109258418 (+3 ms)Region opened successfully at 1676109258418 2023-02-11 09:54:18,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8., pid=32, masterSystemTime=1676109258387 2023-02-11 09:54:18,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:18,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:18,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da22992fcdb8645f6d18a6b22b1a57ae, NAME => 'testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 09:54:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:18,421 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=673673bfe0aa18b892e937412149ace8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,421 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676109258421"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109258421"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109258421"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109258421"}]},"ts":"1676109258421"} 2023-02-11 09:54:18,422 INFO [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,423 DEBUG [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae/family1 2023-02-11 09:54:18,424 DEBUG [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae/family1 2023-02-11 09:54:18,424 INFO [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da22992fcdb8645f6d18a6b22b1a57ae columnFamilyName family1 2023-02-11 09:54:18,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-11 09:54:18,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 673673bfe0aa18b892e937412149ace8, server=jenkins-hbase4.apache.org,43463,1676109215499 in 187 msec 2023-02-11 09:54:18,425 INFO [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] regionserver.HStore(310): Store=da22992fcdb8645f6d18a6b22b1a57ae/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:18,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=673673bfe0aa18b892e937412149ace8, ASSIGN in 345 msec 2023-02-11 09:54:18,425 INFO [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,427 DEBUG [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae/family2 2023-02-11 09:54:18,427 DEBUG [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae/family2 2023-02-11 09:54:18,427 INFO [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da22992fcdb8645f6d18a6b22b1a57ae columnFamilyName family2 2023-02-11 09:54:18,428 INFO [StoreOpener-da22992fcdb8645f6d18a6b22b1a57ae-1] regionserver.HStore(310): Store=da22992fcdb8645f6d18a6b22b1a57ae/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:18,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:54:18,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:54:18,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:54:18,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da22992fcdb8645f6d18a6b22b1a57ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64691508, jitterRate=-0.036021411418914795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:54:18,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da22992fcdb8645f6d18a6b22b1a57ae: Running coprocessor pre-open hook at 1676109258421Writing region info on filesystem at 1676109258421Initializing all the Stores at 1676109258422 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109258422Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109258422Cleaning up temporary data from old regions at 1676109258430 (+8 ms)Cleaning up detritus from prior splits at 1676109258430Running coprocessor post-open hooks at 1676109258434 (+4 ms)Region opened successfully at 1676109258434 2023-02-11 09:54:18,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae., pid=33, masterSystemTime=1676109258387 2023-02-11 09:54:18,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:18,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:18,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=da22992fcdb8645f6d18a6b22b1a57ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:18,436 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676109258436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109258436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109258436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109258436"}]},"ts":"1676109258436"} 2023-02-11 09:54:18,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-02-11 09:54:18,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure da22992fcdb8645f6d18a6b22b1a57ae, server=jenkins-hbase4.apache.org,43463,1676109215499 in 201 msec 2023-02-11 09:54:18,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-02-11 09:54:18,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=da22992fcdb8645f6d18a6b22b1a57ae, ASSIGN in 360 msec 2023-02-11 09:54:18,441 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:54:18,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109258441"}]},"ts":"1676109258441"} 2023-02-11 09:54:18,442 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-11 09:54:18,445 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:54:18,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2530 sec 2023-02-11 09:54:19,017 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-11 09:54:19,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-11 09:54:19,302 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-11 09:54:19,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,312 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-11 09:54:19,312 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:19,312 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-11 09:54:19,312 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-11 09:54:19,312 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,312 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,314 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,314 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:19,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:19,314 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,314 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,316 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-11 09:54:19,316 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:19,316 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-11 09:54:19,316 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:19,316 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. started... 2023-02-11 09:54:19,316 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:19,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:19,316 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:54:19,317 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:19,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. started... 2023-02-11 09:54:19,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for da22992fcdb8645f6d18a6b22b1a57ae: 2023-02-11 09:54:19,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. started... 2023-02-11 09:54:19,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:19,318 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fdf5a340462b75ac8dcb6a5d2682295f: 2023-02-11 09:54:19,318 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 673673bfe0aa18b892e937412149ace8 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-11 09:54:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:54:19,318 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:19,318 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:54:19,335 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b0e87223c79f42fab3c6d4d47fdb59c3 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211b0e87223c79f42fab3c6d4d47fdb59c3 2023-02-11 09:54:19,743 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/.tmp/family1/a1fa86f8a5a94308b13bd8d622e2bb13 2023-02-11 09:54:19,748 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/.tmp/family1/a1fa86f8a5a94308b13bd8d622e2bb13 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/a1fa86f8a5a94308b13bd8d622e2bb13 2023-02-11 09:54:19,752 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/a1fa86f8a5a94308b13bd8d622e2bb13, entries=1, sequenceid=5, filesize=4.9 K 2023-02-11 09:54:19,753 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 673673bfe0aa18b892e937412149ace8 in 435ms, sequenceid=5, compaction requested=false 2023-02-11 09:54:19,754 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 673673bfe0aa18b892e937412149ace8: 2023-02-11 09:54:19,754 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:19,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:54:19,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:54:19,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-11 09:54:19,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-11 09:54:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,757 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:19,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,757 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:19,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:19,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-11 09:54:19,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a547955[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:19,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-11 09:54:19,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,760 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-11 09:54:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-11 09:54:19,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:19,760 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,760 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:19,761 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-11 09:54:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:19,761 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:19,762 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-11 09:54:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:19,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-11 09:54:19,764 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-11 09:54:19,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:19,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:19,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,764 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:19,765 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,766 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:19,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,766 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:19,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:19,766 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,767 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-11 09:54:19,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,773 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:19,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:19,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,773 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:19,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:19,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:19,774 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,874 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:19,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:19,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,881 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-11 09:54:19,881 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:19,881 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-11 09:54:19,881 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-11 09:54:19,881 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,881 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,883 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:19,883 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:19,883 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:19,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,883 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:19,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,884 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,884 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-11 09:54:19,884 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-11 09:54:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:19,884 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. started... 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. started... 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for da22992fcdb8645f6d18a6b22b1a57ae: 2023-02-11 09:54:19,886 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 673673bfe0aa18b892e937412149ace8 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:54:19,886 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:54:19,886 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:19,886 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. started... 2023-02-11 09:54:19,886 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:54:19,887 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fdf5a340462b75ac8dcb6a5d2682295f: 2023-02-11 09:54:19,887 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:54:19,887 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:54:20,300 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302117d89338da9014d73a4dcb4ab4f18e415 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302117d89338da9014d73a4dcb4ab4f18e415 2023-02-11 09:54:20,705 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/.tmp/family1/2a05c0221d3f4636b443b3d0d5ab8cc2 2023-02-11 09:54:20,710 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/.tmp/family1/2a05c0221d3f4636b443b3d0d5ab8cc2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/2a05c0221d3f4636b443b3d0d5ab8cc2 2023-02-11 09:54:20,714 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/2a05c0221d3f4636b443b3d0d5ab8cc2, entries=2, sequenceid=9, filesize=5.0 K 2023-02-11 09:54:20,715 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 673673bfe0aa18b892e937412149ace8 in 829ms, sequenceid=9, compaction requested=false 2023-02-11 09:54:20,715 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 673673bfe0aa18b892e937412149ace8: 2023-02-11 09:54:20,715 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:20,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:54:20,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:54:20,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-11 09:54:20,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-11 09:54:20,717 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,717 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:20,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-11 09:54:20,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4001f59a[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:20,718 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-11 09:54:20,718 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,720 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-11 09:54:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-11 09:54:20,721 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:20,721 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,721 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-11 09:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:20,722 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,722 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-11 09:54:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:20,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:20,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:20,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:20,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-11 09:54:20,724 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-11 09:54:20,724 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:20,724 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:20,724 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,724 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:20,725 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,725 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:20,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,726 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:20,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:20,726 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,727 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,729 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,730 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:20,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:20,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:20,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:20,730 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:20,830 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:20,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:20,838 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-11 09:54:20,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 09:54:20,840 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 09:54:20,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:20,841 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109860841 2023-02-11 09:54:20,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:54:20,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-11 09:54:20,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 09:54:20,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x3fec6075 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:54:20,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7794bf12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:54:20,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-11 09:54:21,674 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302118d2d5adf69664c0b8cc4f15294f01f31 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302118d2d5adf69664c0b8cc4f15294f01f31 2023-02-11 09:54:21,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 09:54:21,688 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:54:21,689 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:54:21,697 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:54:21,699 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55158, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:54:21,713 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/07dcefef066a4a85adda36197f4fa0f1 first=Optional[k0] last=Optional[k1] 2023-02-11 09:54:21,714 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/07dcefef066a4a85adda36197f4fa0f1}] 2023-02-11 09:54:21,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/07dcefef066a4a85adda36197f4fa0f1 for inclusion in 673673bfe0aa18b892e937412149ace8/family1 2023-02-11 09:54:21,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-11 09:54:21,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 09:54:21,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 673673bfe0aa18b892e937412149ace8: 2023-02-11 09:54:21,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211/family1/07dcefef066a4a85adda36197f4fa0f1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testScannerOnBulkLoadRefHFiles__q5d9e4qjb68csraeasj9gdtn6jm1a645qunogcka55or6rdvn92jmd2iij6hi7cm/family1/07dcefef066a4a85adda36197f4fa0f1 2023-02-11 09:54:21,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testScannerOnBulkLoadRefHFiles__q5d9e4qjb68csraeasj9gdtn6jm1a645qunogcka55or6rdvn92jmd2iij6hi7cm/family1/07dcefef066a4a85adda36197f4fa0f1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_ 2023-02-11 09:54:21,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testScannerOnBulkLoadRefHFiles__q5d9e4qjb68csraeasj9gdtn6jm1a645qunogcka55or6rdvn92jmd2iij6hi7cm/family1/07dcefef066a4a85adda36197f4fa0f1 into 673673bfe0aa18b892e937412149ace8/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_ - updating store file list. 2023-02-11 09:54:21,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_ into 673673bfe0aa18b892e937412149ace8/family1 2023-02-11 09:54:21,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testScannerOnBulkLoadRefHFiles__q5d9e4qjb68csraeasj9gdtn6jm1a645qunogcka55or6rdvn92jmd2iij6hi7cm/family1/07dcefef066a4a85adda36197f4fa0f1 into 673673bfe0aa18b892e937412149ace8/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_) 2023-02-11 09:54:21,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testScannerOnBulkLoadRefHFiles__q5d9e4qjb68csraeasj9gdtn6jm1a645qunogcka55or6rdvn92jmd2iij6hi7cm/family1/07dcefef066a4a85adda36197f4fa0f1 2023-02-11 09:54:21,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 09:54:21,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 09:54:21,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 673673bfe0aa18b892e937412149ace8/family1 is initiating minor compaction (all files) 2023-02-11 09:54:21,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@307deba; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:21,732 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 673673bfe0aa18b892e937412149ace8/family1 in testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:54:21,732 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/a1fa86f8a5a94308b13bd8d622e2bb13, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/2a05c0221d3f4636b443b3d0d5ab8cc2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/.tmp, totalSize=15.1 K 2023-02-11 09:54:21,733 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting a1fa86f8a5a94308b13bd8d622e2bb13, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109259302 2023-02-11 09:54:21,733 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 2a05c0221d3f4636b443b3d0d5ab8cc2, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109259302 2023-02-11 09:54:21,734 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109259302 2023-02-11 09:54:21,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 09:54:21,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:21,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302117d89338da9014d73a4dcb4ab4f18e415 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302117d89338da9014d73a4dcb4ab4f18e415 2023-02-11 09:54:21,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211b0e87223c79f42fab3c6d4d47fdb59c3 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230211b0e87223c79f42fab3c6d4d47fdb59c3 2023-02-11 09:54:21,738 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-11 09:54:21,738 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 09:54:21,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-11 09:54:21,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-11 09:54:21,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:21,740 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-11 09:54:21,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 901 msec 2023-02-11 09:54:21,744 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 673673bfe0aa18b892e937412149ace8#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:21,777 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251 (was 260), OpenFileDescriptor=589 (was 605), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=295 (was 312), ProcessCount=169 (was 169), AvailableMemoryMB=2801 (was 2822) 2023-02-11 09:54:21,787 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=295, ProcessCount=169, AvailableMemoryMB=2800 2023-02-11 09:54:21,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 09:54:21,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:21,791 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:54:21,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-11 09:54:21,792 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:54:21,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 09:54:21,793 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:21,794 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366 empty. 2023-02-11 09:54:21,794 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:21,794 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-11 09:54:21,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 09:54:22,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 09:54:22,202 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 09:54:22,203 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7db8f71fb7d3b894b4386ef896bc3366, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:54:22,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 09:54:22,609 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:22,609 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 7db8f71fb7d3b894b4386ef896bc3366, disabling compactions & flushes 2023-02-11 09:54:22,609 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:22,609 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:22,609 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. after waiting 0 ms 2023-02-11 09:54:22,609 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:22,609 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:22,609 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 7db8f71fb7d3b894b4386ef896bc3366: Waiting for close lock at 1676109262609Disabling compacts and flushes for region at 1676109262609Disabling writes for close at 1676109262609Writing region close event to WAL at 1676109262609Closed at 1676109262609 2023-02-11 09:54:22,612 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:54:22,613 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676109262613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109262613"}]},"ts":"1676109262613"} 2023-02-11 09:54:22,614 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:54:22,615 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:54:22,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109262615"}]},"ts":"1676109262615"} 2023-02-11 09:54:22,616 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-11 09:54:22,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7db8f71fb7d3b894b4386ef896bc3366, ASSIGN}] 2023-02-11 09:54:22,620 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7db8f71fb7d3b894b4386ef896bc3366, ASSIGN 2023-02-11 09:54:22,621 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7db8f71fb7d3b894b4386ef896bc3366, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:54:22,772 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7db8f71fb7d3b894b4386ef896bc3366, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:22,772 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676109262772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109262772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109262772"}]},"ts":"1676109262772"} 2023-02-11 09:54:22,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 7db8f71fb7d3b894b4386ef896bc3366, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:22,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 09:54:22,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:22,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7db8f71fb7d3b894b4386ef896bc3366, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:54:22,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:22,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:22,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:22,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:22,930 INFO [StoreOpener-7db8f71fb7d3b894b4386ef896bc3366-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:22,931 DEBUG [StoreOpener-7db8f71fb7d3b894b4386ef896bc3366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1 2023-02-11 09:54:22,931 DEBUG [StoreOpener-7db8f71fb7d3b894b4386ef896bc3366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1 2023-02-11 09:54:22,932 INFO [StoreOpener-7db8f71fb7d3b894b4386ef896bc3366-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7db8f71fb7d3b894b4386ef896bc3366 columnFamilyName family1 2023-02-11 09:54:22,933 INFO [StoreOpener-7db8f71fb7d3b894b4386ef896bc3366-1] regionserver.HStore(310): Store=7db8f71fb7d3b894b4386ef896bc3366/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:22,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:22,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:22,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:54:22,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:54:22,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7db8f71fb7d3b894b4386ef896bc3366; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75025764, jitterRate=0.11797100305557251}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:54:22,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7db8f71fb7d3b894b4386ef896bc3366: Running coprocessor pre-open hook at 1676109262929Writing region info on filesystem at 1676109262929Initializing all the Stores at 1676109262930 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676109262930Cleaning up temporary data from old regions at 1676109262935 (+5 ms)Cleaning up detritus from prior splits at 1676109262935Running coprocessor post-open hooks at 1676109262939 (+4 ms)Region opened successfully at 1676109262939 2023-02-11 09:54:22,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366., pid=37, masterSystemTime=1676109262926 2023-02-11 09:54:22,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:22,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:22,941 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7db8f71fb7d3b894b4386ef896bc3366, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:22,942 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676109262941"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109262941"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109262941"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109262941"}]},"ts":"1676109262941"} 2023-02-11 09:54:22,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-11 09:54:22,945 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 7db8f71fb7d3b894b4386ef896bc3366, server=jenkins-hbase4.apache.org,43463,1676109215499 in 169 msec 2023-02-11 09:54:22,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-11 09:54:22,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=7db8f71fb7d3b894b4386ef896bc3366, ASSIGN in 326 msec 2023-02-11 09:54:22,947 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:54:22,947 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109262947"}]},"ts":"1676109262947"} 2023-02-11 09:54:22,948 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-11 09:54:22,950 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:54:22,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1610 sec 2023-02-11 09:54:22,963 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/.tmp/family1/4abfebdd399147e0a81c252e6b775dde as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/4abfebdd399147e0a81c252e6b775dde 2023-02-11 09:54:22,967 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 673673bfe0aa18b892e937412149ace8/family1 of 673673bfe0aa18b892e937412149ace8 into 4abfebdd399147e0a81c252e6b775dde(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:54:22,967 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 673673bfe0aa18b892e937412149ace8: 2023-02-11 09:54:22,967 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676109261732; duration=1sec 2023-02-11 09:54:22,967 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:23,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/a1fa86f8a5a94308b13bd8d622e2bb13, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/2a05c0221d3f4636b443b3d0d5ab8cc2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_] to archive 2023-02-11 09:54:23,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:23,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/a1fa86f8a5a94308b13bd8d622e2bb13 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/a1fa86f8a5a94308b13bd8d622e2bb13 2023-02-11 09:54:23,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/2a05c0221d3f4636b443b3d0d5ab8cc2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/2a05c0221d3f4636b443b3d0d5ab8cc2 2023-02-11 09:54:23,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/family1/f11f9a2c98e44a8cbb59a2e35afeb3db_SeqId_12_ 2023-02-11 09:54:23,892 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:54:23,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-11 09:54:23,897 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-11 09:54:23,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:23,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,927 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:23,927 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:23,927 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:23,927 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:23,928 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,928 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,930 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:23,930 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:23,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:23,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:23,930 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:23,930 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:23,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,931 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:23,931 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:23,931 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:23,931 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:23,934 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:23,934 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:23,934 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:23,934 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:23,935 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 09:54:24,356 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f2d6d25e6f1e468e9bf30e81f15acec5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f2d6d25e6f1e468e9bf30e81f15acec5 2023-02-11 09:54:24,760 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/ab60d8a6797b4a2e90038ef54760272a 2023-02-11 09:54:24,767 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/ab60d8a6797b4a2e90038ef54760272a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/ab60d8a6797b4a2e90038ef54760272a 2023-02-11 09:54:24,772 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/ab60d8a6797b4a2e90038ef54760272a, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-11 09:54:24,773 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 838ms, sequenceid=5, compaction requested=false 2023-02-11 09:54:24,773 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:24,774 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:24,774 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:24,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:24,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:24,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:24,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:24,776 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,776 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,776 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:24,777 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:24,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:24,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3982e596[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:24,779 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:24,779 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,783 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,783 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:24,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:24,783 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:24,783 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:24,785 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,785 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:24,785 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:24,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:24,786 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:24,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:24,788 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:24,788 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:24,788 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:24,788 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,788 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:24,789 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,789 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,789 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:24,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:24,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:24,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:24,790 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,791 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,793 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:24,793 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:24,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:24,794 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:24,793 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:24,794 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:24,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:24,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:24,894 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:24,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:24,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:24,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:24,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,901 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:24,901 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:24,901 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:24,901 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:24,902 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,902 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,903 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:24,903 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:24,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:24,904 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:24,904 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:24,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,905 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,906 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:24,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:24,906 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:24,906 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:24,906 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:24,906 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:24,906 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:24,906 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:24,907 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:24,907 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 09:54:24,921 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112892a4b946e4f347679d15588bd9d8ef45 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112892a4b946e4f347679d15588bd9d8ef45 2023-02-11 09:54:25,330 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/0bf5dc1e72044749a82820f097531ee2 2023-02-11 09:54:25,335 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/0bf5dc1e72044749a82820f097531ee2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/0bf5dc1e72044749a82820f097531ee2 2023-02-11 09:54:25,338 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/0bf5dc1e72044749a82820f097531ee2, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 09:54:25,339 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 432ms, sequenceid=9, compaction requested=false 2023-02-11 09:54:25,340 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:25,340 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:25,340 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:25,342 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,342 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:25,342 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,342 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@458754a1[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:25,343 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:25,344 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,348 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,349 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:25,349 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:25,349 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:25,349 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,349 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:25,350 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,350 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:25,350 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:25,351 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:25,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:25,353 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:25,353 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:25,353 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:25,353 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,353 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:25,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:25,355 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,356 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:25,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:25,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:25,360 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:25,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:25,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:25,360 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:25,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:25,460 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:25,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:25,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:25,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,467 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:25,467 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:25,467 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:25,467 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:25,467 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,467 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,468 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,468 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:25,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:25,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:25,469 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,469 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:25,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:25,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,469 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,470 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:25,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:25,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:25,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:25,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:25,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:25,470 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:25,470 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:25,470 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:25,884 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201776a704dab244bb3a16c09277f0296e4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201776a704dab244bb3a16c09277f0296e4 2023-02-11 09:54:25,891 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/7a09479af9334749850d2a436cce9131 2023-02-11 09:54:25,897 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/7a09479af9334749850d2a436cce9131 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7a09479af9334749850d2a436cce9131 2023-02-11 09:54:25,902 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7a09479af9334749850d2a436cce9131, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 09:54:25,902 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 432ms, sequenceid=13, compaction requested=true 2023-02-11 09:54:25,903 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:25,903 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:25,905 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,905 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:25,905 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,905 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:25,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:25,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c800395[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:25,907 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:25,907 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,908 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,909 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:25,909 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:25,909 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:25,909 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,909 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:25,911 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:25,911 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,911 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,911 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:25,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:25,913 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:25,913 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:25,913 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:25,914 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,914 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:25,915 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,915 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:25,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,915 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:25,916 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,917 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:25,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:25,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:25,919 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:25,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:25,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:25,919 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:26,020 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:26,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:26,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:26,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:26,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,026 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:26,026 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:26,026 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:26,026 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:26,026 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,026 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,028 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,028 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:26,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:26,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:26,028 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,028 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:26,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:26,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,029 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,029 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:26,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:26,029 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:26,029 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:26,029 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:26,442 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205bf0621ffab68448ea46127abe91a08ca to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205bf0621ffab68448ea46127abe91a08ca 2023-02-11 09:54:26,450 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/283ba8db3a8b4f4680632c9c8eabaec5 2023-02-11 09:54:26,456 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/283ba8db3a8b4f4680632c9c8eabaec5 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/283ba8db3a8b4f4680632c9c8eabaec5 2023-02-11 09:54:26,461 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/283ba8db3a8b4f4680632c9c8eabaec5, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 09:54:26,462 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 433ms, sequenceid=17, compaction requested=true 2023-02-11 09:54:26,462 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:26,462 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:26,462 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:26,462 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:26,462 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,462 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:26,462 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:26,464 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,464 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:26,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:26,465 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,465 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:26,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:26,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@136280ba[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:26,466 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:26,466 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,467 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:26,468 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:26,468 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,468 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:26,471 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:26,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:26,471 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:26,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:26,474 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:26,474 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:26,474 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:26,474 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,474 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:26,476 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,476 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,476 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:26,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:26,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:26,476 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,477 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:26,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:26,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:26,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:26,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:26,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:26,479 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:26,480 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:26,480 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:26,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:26,580 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:26,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:26,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:26,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:26,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,587 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:26,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:26,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:26,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:26,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,589 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:26,589 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:26,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:26,589 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:26,589 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:26,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,590 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:26,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:26,590 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:26,591 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:26,591 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:26,591 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:26,591 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:26,591 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:26,591 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:26,591 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:27,009 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280c99520a8c544a4498bed04ed7e3a2fe to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280c99520a8c544a4498bed04ed7e3a2fe 2023-02-11 09:54:27,415 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/a25c9ece76944869b38fbd9aeb50e354 2023-02-11 09:54:27,421 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/a25c9ece76944869b38fbd9aeb50e354 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a25c9ece76944869b38fbd9aeb50e354 2023-02-11 09:54:27,426 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a25c9ece76944869b38fbd9aeb50e354, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 09:54:27,427 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 836ms, sequenceid=21, compaction requested=true 2023-02-11 09:54:27,427 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:27,427 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:27,427 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:27,427 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:27,427 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,427 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:27,427 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:27,435 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,435 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:27,435 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,435 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:27,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:27,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d627915[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:27,437 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:27,437 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,441 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,441 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:27,441 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:27,441 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:27,441 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,441 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:27,443 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:27,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:27,443 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:27,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:27,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:27,446 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:27,446 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:27,446 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:27,446 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,446 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:27,448 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,448 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:27,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,448 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:27,448 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:27,449 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,452 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:27,452 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:27,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:27,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:27,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:27,452 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,453 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,453 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,453 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,453 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,453 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,453 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:27,452 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:27,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:27,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:27,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:27,453 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:27,454 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:27,554 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:27,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:27,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:27,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:27,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,560 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:27,560 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:27,560 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:27,561 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:27,561 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,561 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,562 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:27,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:27,563 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,564 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:27,564 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:27,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,564 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,564 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:27,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:27,565 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:27,565 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:27,565 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:27,979 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311ec5f47f4b5b462fbe165cd83b22a622 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311ec5f47f4b5b462fbe165cd83b22a622 2023-02-11 09:54:28,384 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/e033f244a52441a99cf2452c81c4ecd8 2023-02-11 09:54:28,389 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/e033f244a52441a99cf2452c81c4ecd8 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/e033f244a52441a99cf2452c81c4ecd8 2023-02-11 09:54:28,392 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/e033f244a52441a99cf2452c81c4ecd8, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 09:54:28,393 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 828ms, sequenceid=25, compaction requested=true 2023-02-11 09:54:28,393 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:28,393 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:28,393 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:28,393 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:28,393 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,394 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:28,394 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:28,395 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,395 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:28,395 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,395 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:28,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:28,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42bf1044[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:28,397 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:28,397 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,398 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:28,398 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:28,398 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,398 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:28,400 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,400 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:28,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:28,403 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:28,403 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:28,403 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:28,403 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,403 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:28,405 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,405 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:28,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,405 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:28,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:28,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,409 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,411 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,411 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:28,411 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,411 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:28,411 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:28,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:28,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:28,411 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:28,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:28,412 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,412 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,412 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:28,412 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:28,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:28,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:28,412 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,412 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,512 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:28,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:28,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:28,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:28,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,519 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:28,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:28,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:28,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:28,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,519 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:28,520 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:28,521 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,521 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:28,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,521 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,522 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:28,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:28,522 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:28,522 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:28,522 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:28,522 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:28,934 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601014e5d824f4e9c480683eba6780e00e694 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014e5d824f4e9c480683eba6780e00e694 2023-02-11 09:54:29,340 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/a765ecf4210c4ab69f8cf1a56f141e86 2023-02-11 09:54:29,345 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/a765ecf4210c4ab69f8cf1a56f141e86 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a765ecf4210c4ab69f8cf1a56f141e86 2023-02-11 09:54:29,348 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a765ecf4210c4ab69f8cf1a56f141e86, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 09:54:29,349 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 827ms, sequenceid=29, compaction requested=true 2023-02-11 09:54:29,349 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:29,349 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:29,350 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:29,350 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:29,350 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,350 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:29,350 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:29,352 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,352 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:29,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:29,353 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,353 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:29,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:29,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:29,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e7f2f2d[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:29,354 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:29,354 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,356 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:29,356 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,356 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:29,358 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,359 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:29,359 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:29,359 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:29,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:29,361 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:29,361 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:29,361 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:29,361 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,361 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:29,362 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,362 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:29,362 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,363 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,364 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,370 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:29,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:29,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:29,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:29,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:29,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,370 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:29,471 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:29,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:29,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:29,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:29,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,477 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:29,477 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:29,477 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:29,477 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:29,477 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,477 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,480 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:29,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:29,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,481 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:29,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:29,481 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:29,482 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:29,482 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:29,897 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c9c94ceeafc745c6bd8d79c74339ee70 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c9c94ceeafc745c6bd8d79c74339ee70 2023-02-11 09:54:29,907 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/fdabc2d78cc74c5fbe6608a70de91e34 2023-02-11 09:54:29,912 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/fdabc2d78cc74c5fbe6608a70de91e34 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/fdabc2d78cc74c5fbe6608a70de91e34 2023-02-11 09:54:29,917 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/fdabc2d78cc74c5fbe6608a70de91e34, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 09:54:29,918 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 435ms, sequenceid=33, compaction requested=true 2023-02-11 09:54:29,918 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:29,918 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:29,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:29,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:29,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:29,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:29,920 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,920 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:29,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:29,920 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:29,920 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:29,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:29,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:29,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@191f1b08[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:29,921 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:29,921 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,922 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,922 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:29,923 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:29,923 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:29,923 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,923 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:29,925 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:29,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:29,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:29,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:29,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:29,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:29,927 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:29,927 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:29,928 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:29,928 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,928 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:29,929 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,929 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:29,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,929 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:29,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:29,929 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:29,932 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,934 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:29,935 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:29,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:29,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:29,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:29,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:29,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:29,935 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:29,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:30,035 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:30,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:30,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:30,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:30,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,042 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:30,042 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:30,042 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:30,042 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:30,042 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,042 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,043 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:30,043 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:30,044 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,044 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:30,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,044 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:30,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,045 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:30,045 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:30,045 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:30,045 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:30,045 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:30,045 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:30,045 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:30,045 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:30,457 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907be461642f79c4aaa9f2d8ae424f34a5b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907be461642f79c4aaa9f2d8ae424f34a5b 2023-02-11 09:54:30,863 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/67986455329745d6b4eae5be71ba0bfb 2023-02-11 09:54:30,868 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/67986455329745d6b4eae5be71ba0bfb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/67986455329745d6b4eae5be71ba0bfb 2023-02-11 09:54:30,875 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/67986455329745d6b4eae5be71ba0bfb, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 09:54:30,876 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 831ms, sequenceid=37, compaction requested=true 2023-02-11 09:54:30,876 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:30,876 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:30,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:30,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:30,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:30,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:30,878 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,878 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:30,878 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,878 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:30,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:30,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@371b63ef[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:30,880 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:30,880 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,881 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,881 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:30,881 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:30,881 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:30,881 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,881 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:30,884 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:30,884 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,884 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:30,884 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:30,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:30,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:30,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:30,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:30,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:30,886 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:30,886 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:30,887 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:30,887 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,887 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:30,888 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,888 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:30,888 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:30,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:30,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:30,889 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:30,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,891 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:30,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:30,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:30,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:30,893 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:30,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,893 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:30,894 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:30,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:30,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:30,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:30,894 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,894 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,894 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:30,894 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:30,894 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:30,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:30,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:30,994 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:30,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:30,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:31,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:31,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,001 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:31,001 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:31,001 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-11 09:54:31,001 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-11 09:54:31,001 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,001 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,002 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,002 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:31,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:31,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:31,002 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,002 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:31,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,003 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-11 09:54:31,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-11 09:54:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-11 09:54:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:31,004 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:31,004 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. started... 2023-02-11 09:54:31,004 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db8f71fb7d3b894b4386ef896bc3366 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:31,416 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208200cbf98734441faef51a268b3f946d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511208200cbf98734441faef51a268b3f946d 2023-02-11 09:54:31,822 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/28b22403b9704bff86404874fb164d4e 2023-02-11 09:54:31,826 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/28b22403b9704bff86404874fb164d4e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/28b22403b9704bff86404874fb164d4e 2023-02-11 09:54:31,830 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/28b22403b9704bff86404874fb164d4e, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 09:54:31,831 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7db8f71fb7d3b894b4386ef896bc3366 in 827ms, sequenceid=41, compaction requested=true 2023-02-11 09:54:31,831 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:31,831 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-11 09:54:31,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-11 09:54:31,834 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:31,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-11 09:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d9c7878[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:31,835 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-11 09:54:31,835 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,837 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-11 09:54:31,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-11 09:54:31,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:31,837 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,837 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:31,838 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-11 09:54:31,838 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,838 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:31,838 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-11 09:54:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:31,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:54:31,840 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-11 09:54:31,840 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:31,840 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:31,840 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,840 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:31,842 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,842 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:31,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,842 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:31,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:31,842 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:31,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,843 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-11 09:54:31,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-11 09:54:31,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:31,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:31,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:31,849 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:31,849 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:31,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:31,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:31,949 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:31,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:31,951 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-11 09:54:31,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:31,954 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:31,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:31,955 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109871954 2023-02-11 09:54:31,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:54:31,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-11 09:54:31,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:31,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x012985ba to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:54:31,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5317d6a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:54:31,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,799 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010341e2dd7845f3455ba39741178f849074 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010341e2dd7845f3455ba39741178f849074 2023-02-11 09:54:32,799 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:32,812 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:54:32,813 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38866, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:54:32,819 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:54:32,820 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:54:32,828 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c1a7fc1eb8a1400c81c125d48d36322a first=Optional[r3] last=Optional[r6] 2023-02-11 09:54:32,828 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c1a7fc1eb8a1400c81c125d48d36322a}] 2023-02-11 09:54:32,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c1a7fc1eb8a1400c81c125d48d36322a for inclusion in 7db8f71fb7d3b894b4386ef896bc3366/family1 2023-02-11 09:54:32,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 09:54:32,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:32,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:32,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c1a7fc1eb8a1400c81c125d48d36322a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b532gl93u9qhqq0iv2hf07b3uu4c5didnv9bnttnv0143vimf950diadf9j2v5hd/family1/c1a7fc1eb8a1400c81c125d48d36322a 2023-02-11 09:54:32,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b532gl93u9qhqq0iv2hf07b3uu4c5didnv9bnttnv0143vimf950diadf9j2v5hd/family1/c1a7fc1eb8a1400c81c125d48d36322a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_ 2023-02-11 09:54:32,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b532gl93u9qhqq0iv2hf07b3uu4c5didnv9bnttnv0143vimf950diadf9j2v5hd/family1/c1a7fc1eb8a1400c81c125d48d36322a into 7db8f71fb7d3b894b4386ef896bc3366/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_ - updating store file list. 2023-02-11 09:54:32,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_ into 7db8f71fb7d3b894b4386ef896bc3366/family1 2023-02-11 09:54:32,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b532gl93u9qhqq0iv2hf07b3uu4c5didnv9bnttnv0143vimf950diadf9j2v5hd/family1/c1a7fc1eb8a1400c81c125d48d36322a into 7db8f71fb7d3b894b4386ef896bc3366/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_) 2023-02-11 09:54:32,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__b532gl93u9qhqq0iv2hf07b3uu4c5didnv9bnttnv0143vimf950diadf9j2v5hd/family1/c1a7fc1eb8a1400c81c125d48d36322a 2023-02-11 09:54:32,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 09:54:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 09:54:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 7db8f71fb7d3b894b4386ef896bc3366/family1 is initiating minor compaction 2023-02-11 09:54:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@23ffc2b7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:32,844 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7db8f71fb7d3b894b4386ef896bc3366/family1 in testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:32,844 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/0bf5dc1e72044749a82820f097531ee2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7a09479af9334749850d2a436cce9131, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/283ba8db3a8b4f4680632c9c8eabaec5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a25c9ece76944869b38fbd9aeb50e354, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/e033f244a52441a99cf2452c81c4ecd8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a765ecf4210c4ab69f8cf1a56f141e86, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/fdabc2d78cc74c5fbe6608a70de91e34, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/67986455329745d6b4eae5be71ba0bfb, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/28b22403b9704bff86404874fb164d4e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp, totalSize=50.0 K 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 0bf5dc1e72044749a82820f097531ee2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 7a09479af9334749850d2a436cce9131, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 283ba8db3a8b4f4680632c9c8eabaec5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting a25c9ece76944869b38fbd9aeb50e354, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting e033f244a52441a99cf2452c81c4ecd8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting a765ecf4210c4ab69f8cf1a56f141e86, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting fdabc2d78cc74c5fbe6608a70de91e34, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 67986455329745d6b4eae5be71ba0bfb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 28b22403b9704bff86404874fb164d4e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 09:54:32,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 7e52a3ac8a384b989be7857970e168bf_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 09:54:32,846 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:32,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:32,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280c99520a8c544a4498bed04ed7e3a2fe to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280c99520a8c544a4498bed04ed7e3a2fe 2023-02-11 09:54:32,850 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311ec5f47f4b5b462fbe165cd83b22a622 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311ec5f47f4b5b462fbe165cd83b22a622 2023-02-11 09:54:32,851 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014e5d824f4e9c480683eba6780e00e694 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601014e5d824f4e9c480683eba6780e00e694 2023-02-11 09:54:32,853 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c9c94ceeafc745c6bd8d79c74339ee70 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c9c94ceeafc745c6bd8d79c74339ee70 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-11 09:54:32,853 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:32,877 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7db8f71fb7d3b894b4386ef896bc3366#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:32,906 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/6494ed547873488ea10606ca9fef68a1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/6494ed547873488ea10606ca9fef68a1 2023-02-11 09:54:32,911 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7db8f71fb7d3b894b4386ef896bc3366/family1 of 7db8f71fb7d3b894b4386ef896bc3366 into 6494ed547873488ea10606ca9fef68a1(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:54:32,911 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:32,911 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676109272844; duration=0sec 2023-02-11 09:54:32,911 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:32,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/0bf5dc1e72044749a82820f097531ee2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7a09479af9334749850d2a436cce9131, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/283ba8db3a8b4f4680632c9c8eabaec5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a25c9ece76944869b38fbd9aeb50e354, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/e033f244a52441a99cf2452c81c4ecd8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a765ecf4210c4ab69f8cf1a56f141e86, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/fdabc2d78cc74c5fbe6608a70de91e34, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/67986455329745d6b4eae5be71ba0bfb, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/28b22403b9704bff86404874fb164d4e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_] to archive 2023-02-11 09:54:32,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:32,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/0bf5dc1e72044749a82820f097531ee2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/0bf5dc1e72044749a82820f097531ee2 2023-02-11 09:54:32,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7a09479af9334749850d2a436cce9131 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7a09479af9334749850d2a436cce9131 2023-02-11 09:54:32,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/283ba8db3a8b4f4680632c9c8eabaec5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/283ba8db3a8b4f4680632c9c8eabaec5 2023-02-11 09:54:32,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a25c9ece76944869b38fbd9aeb50e354 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a25c9ece76944869b38fbd9aeb50e354 2023-02-11 09:54:32,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/e033f244a52441a99cf2452c81c4ecd8 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/e033f244a52441a99cf2452c81c4ecd8 2023-02-11 09:54:32,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a765ecf4210c4ab69f8cf1a56f141e86 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/a765ecf4210c4ab69f8cf1a56f141e86 2023-02-11 09:54:32,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/fdabc2d78cc74c5fbe6608a70de91e34 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/fdabc2d78cc74c5fbe6608a70de91e34 2023-02-11 09:54:32,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/67986455329745d6b4eae5be71ba0bfb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/67986455329745d6b4eae5be71ba0bfb 2023-02-11 09:54:32,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/28b22403b9704bff86404874fb164d4e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/28b22403b9704bff86404874fb164d4e 2023-02-11 09:54:32,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/7e52a3ac8a384b989be7857970e168bf_SeqId_44_ 2023-02-11 09:54:33,703 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053cf46eee4b83478cb3f8ca0de61f76da to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053cf46eee4b83478cb3f8ca0de61f76da 2023-02-11 09:54:33,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:33,729 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7dcbc804b2469db54392e722a9bcc3 first=Optional[r00] last=Optional[r2] 2023-02-11 09:54:33,730 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7dcbc804b2469db54392e722a9bcc3}] 2023-02-11 09:54:33,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7dcbc804b2469db54392e722a9bcc3 for inclusion in 7db8f71fb7d3b894b4386ef896bc3366/family1 2023-02-11 09:54:33,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 09:54:33,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:33,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:33,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a7dcbc804b2469db54392e722a9bcc3 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__eh2t4jdd5rr4fcuoqustcaq9h3kkapad9fqsu3hklaamlp4h1lrfqbk65r3h26ok/family1/2a7dcbc804b2469db54392e722a9bcc3 2023-02-11 09:54:33,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__eh2t4jdd5rr4fcuoqustcaq9h3kkapad9fqsu3hklaamlp4h1lrfqbk65r3h26ok/family1/2a7dcbc804b2469db54392e722a9bcc3 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_ 2023-02-11 09:54:33,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__eh2t4jdd5rr4fcuoqustcaq9h3kkapad9fqsu3hklaamlp4h1lrfqbk65r3h26ok/family1/2a7dcbc804b2469db54392e722a9bcc3 into 7db8f71fb7d3b894b4386ef896bc3366/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_ - updating store file list. 2023-02-11 09:54:33,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_ into 7db8f71fb7d3b894b4386ef896bc3366/family1 2023-02-11 09:54:33,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__eh2t4jdd5rr4fcuoqustcaq9h3kkapad9fqsu3hklaamlp4h1lrfqbk65r3h26ok/family1/2a7dcbc804b2469db54392e722a9bcc3 into 7db8f71fb7d3b894b4386ef896bc3366/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_) 2023-02-11 09:54:33,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyPolicy__eh2t4jdd5rr4fcuoqustcaq9h3kkapad9fqsu3hklaamlp4h1lrfqbk65r3h26ok/family1/2a7dcbc804b2469db54392e722a9bcc3 2023-02-11 09:54:33,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 09:54:33,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 09:54:33,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 7db8f71fb7d3b894b4386ef896bc3366/family1 is initiating minor compaction (all files) 2023-02-11 09:54:33,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1e92f154; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:33,747 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7db8f71fb7d3b894b4386ef896bc3366/family1 in testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:54:33,747 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/ab60d8a6797b4a2e90038ef54760272a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/6494ed547873488ea10606ca9fef68a1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp, totalSize=337.0 K 2023-02-11 09:54:33,748 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting ab60d8a6797b4a2e90038ef54760272a, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839484 2023-02-11 09:54:33,748 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 6494ed547873488ea10606ca9fef68a1, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239484 2023-02-11 09:54:33,749 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839484 2023-02-11 09:54:33,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:33,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:33,751 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f2d6d25e6f1e468e9bf30e81f15acec5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f2d6d25e6f1e468e9bf30e81f15acec5 2023-02-11 09:54:33,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201776a704dab244bb3a16c09277f0296e4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201776a704dab244bb3a16c09277f0296e4 2023-02-11 09:54:33,753 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205bf0621ffab68448ea46127abe91a08ca to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205bf0621ffab68448ea46127abe91a08ca 2023-02-11 09:54:33,753 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-11 09:54:33,753 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 09:54:33,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-11 09:54:33,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-11 09:54:33,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:33,755 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:54:33,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8030 sec 2023-02-11 09:54:33,768 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7db8f71fb7d3b894b4386ef896bc3366#family1#compaction#50 average throughput is 14.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:33,842 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257 (was 251) - Thread LEAK? -, OpenFileDescriptor=616 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 295), ProcessCount=176 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=2723 (was 2800) 2023-02-11 09:54:33,854 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=257, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=176, AvailableMemoryMB=2722 2023-02-11 09:54:33,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 09:54:33,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:33,858 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:54:33,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-11 09:54:33,858 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:54:33,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 09:54:33,860 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:33,860 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab empty. 2023-02-11 09:54:33,861 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:33,861 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-11 09:54:33,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 09:54:34,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 09:54:34,269 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-11 09:54:34,270 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 006ee9d5c2deae1724621309680e97ab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:54:34,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 09:54:34,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:34,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing 006ee9d5c2deae1724621309680e97ab, disabling compactions & flushes 2023-02-11 09:54:34,676 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:34,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:34,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. after waiting 0 ms 2023-02-11 09:54:34,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:34,676 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:34,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for 006ee9d5c2deae1724621309680e97ab: Waiting for close lock at 1676109274676Disabling compacts and flushes for region at 1676109274676Disabling writes for close at 1676109274676Writing region close event to WAL at 1676109274676Closed at 1676109274676 2023-02-11 09:54:34,678 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:54:34,679 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109274679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109274679"}]},"ts":"1676109274679"} 2023-02-11 09:54:34,681 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:54:34,681 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:54:34,682 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109274682"}]},"ts":"1676109274682"} 2023-02-11 09:54:34,682 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-11 09:54:34,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, ASSIGN}] 2023-02-11 09:54:34,691 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, ASSIGN 2023-02-11 09:54:34,692 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:54:34,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:34,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109274843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109274843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109274843"}]},"ts":"1676109274843"} 2023-02-11 09:54:34,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:34,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 09:54:34,995 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/.tmp/family1/b60ffc17194348138ffb8cbb78e4e5f3 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/b60ffc17194348138ffb8cbb78e4e5f3 2023-02-11 09:54:34,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:34,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 006ee9d5c2deae1724621309680e97ab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:54:34,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:34,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:34,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:34,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:35,000 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7db8f71fb7d3b894b4386ef896bc3366/family1 of 7db8f71fb7d3b894b4386ef896bc3366 into b60ffc17194348138ffb8cbb78e4e5f3(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:54:35,000 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7db8f71fb7d3b894b4386ef896bc3366: 2023-02-11 09:54:35,000 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676109273747; duration=1sec 2023-02-11 09:54:35,000 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:35,001 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:35,002 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:35,002 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:35,002 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 006ee9d5c2deae1724621309680e97ab columnFamilyName family1 2023-02-11 09:54:35,003 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(310): Store=006ee9d5c2deae1724621309680e97ab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:35,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:35,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:35,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:35,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:54:35,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 006ee9d5c2deae1724621309680e97ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71541709, jitterRate=0.06605453789234161}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:54:35,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 006ee9d5c2deae1724621309680e97ab: Running coprocessor pre-open hook at 1676109275000Writing region info on filesystem at 1676109275000Initializing all the Stores at 1676109275000Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676109275000Cleaning up temporary data from old regions at 1676109275005 (+5 ms)Cleaning up detritus from prior splits at 1676109275005Running coprocessor post-open hooks at 1676109275009 (+4 ms)Region opened successfully at 1676109275009 2023-02-11 09:54:35,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., pid=41, masterSystemTime=1676109274996 2023-02-11 09:54:35,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:35,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:35,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:35,012 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109275012"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109275012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109275012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109275012"}]},"ts":"1676109275012"} 2023-02-11 09:54:35,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-11 09:54:35,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499 in 168 msec 2023-02-11 09:54:35,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-11 09:54:35,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, ASSIGN in 324 msec 2023-02-11 09:54:35,016 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:54:35,017 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109275016"}]},"ts":"1676109275016"} 2023-02-11 09:54:35,018 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-11 09:54:35,020 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:54:35,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1640 sec 2023-02-11 09:54:35,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/ab60d8a6797b4a2e90038ef54760272a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/6494ed547873488ea10606ca9fef68a1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_] to archive 2023-02-11 09:54:35,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:35,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/ab60d8a6797b4a2e90038ef54760272a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/ab60d8a6797b4a2e90038ef54760272a 2023-02-11 09:54:35,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/6494ed547873488ea10606ca9fef68a1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/6494ed547873488ea10606ca9fef68a1 2023-02-11 09:54:35,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/family1/19f76eec0caa4f7e9d369d433e22aefa_SeqId_47_ 2023-02-11 09:54:35,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-11 09:54:35,964 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-11 09:54:35,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:35,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,990 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:35,990 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:35,990 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:35,990 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:35,991 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,991 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,992 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:35,992 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:35,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:35,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:35,993 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:35,993 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:35,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:35,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,993 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:35,994 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:35,994 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:35,994 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:35,994 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:35,994 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:35,994 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:35,994 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:35,995 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 09:54:36,415 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113041cf253f08e5452cab2c9bdd9e80742a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113041cf253f08e5452cab2c9bdd9e80742a 2023-02-11 09:54:36,819 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/61dba3b8f44f49d7a85ffcf3baa3adcd 2023-02-11 09:54:36,824 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/61dba3b8f44f49d7a85ffcf3baa3adcd as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/61dba3b8f44f49d7a85ffcf3baa3adcd 2023-02-11 09:54:36,828 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/61dba3b8f44f49d7a85ffcf3baa3adcd, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-11 09:54:36,829 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 834ms, sequenceid=5, compaction requested=false 2023-02-11 09:54:36,829 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:36,829 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:36,829 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:36,830 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:36,830 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:36,830 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,830 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:36,830 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:36,831 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:36,831 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,832 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:36,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:36,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a7d38a1[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:36,833 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:36,833 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,834 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:36,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:36,834 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:36,834 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,834 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:36,837 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:36,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:36,837 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:36,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:36,839 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:36,839 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:36,839 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:36,839 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,839 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:36,840 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,840 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:36,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,840 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:36,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:36,841 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:36,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,842 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:36,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:36,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:36,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,844 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:36,844 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:36,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:36,945 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:36,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:36,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:36,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:36,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,951 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:36,951 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:36,951 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:36,951 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:36,951 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,951 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,953 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:36,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:36,954 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:36,954 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:36,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,954 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,955 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:36,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:36,955 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:36,955 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:36,955 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:36,955 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 09:54:37,037 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-11 09:54:37,369 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b2b0b17599a54f92a33c92e4c3c40e47 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b2b0b17599a54f92a33c92e4c3c40e47 2023-02-11 09:54:37,775 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/18b93fbc702546108a6d68b4b60be71a 2023-02-11 09:54:37,780 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/18b93fbc702546108a6d68b4b60be71a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/18b93fbc702546108a6d68b4b60be71a 2023-02-11 09:54:37,784 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/18b93fbc702546108a6d68b4b60be71a, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 09:54:37,785 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 830ms, sequenceid=9, compaction requested=false 2023-02-11 09:54:37,785 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:37,785 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:37,785 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:37,785 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:37,785 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,785 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:37,785 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:37,786 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,786 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:37,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:37,787 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,787 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:37,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:37,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b5bb9bd[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:37,788 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:37,788 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,789 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,789 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:37,789 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:37,789 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,789 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:37,789 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:37,791 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,791 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:37,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,791 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:37,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:37,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:37,791 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:37,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:37,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:37,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:37,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:37,793 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:37,793 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:37,793 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:37,794 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,794 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:37,796 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,796 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:37,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:37,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,796 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:37,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:37,797 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:37,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,798 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:37,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,802 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:37,803 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:37,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:37,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:37,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:37,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:37,803 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:37,903 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:37,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:37,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:37,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:37,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,910 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:37,910 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:37,910 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:37,910 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:37,910 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,910 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,912 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:37,912 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:37,912 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:37,912 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:37,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:37,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,913 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,913 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:37,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:37,913 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:37,913 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:37,913 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:37,913 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:37,914 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:37,914 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:37,914 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:37,914 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:38,330 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015033664cc96d4259bb41fd16bd0b476c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512015033664cc96d4259bb41fd16bd0b476c 2023-02-11 09:54:38,736 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/a51b534ee40d486e8aad2c57cf47ba25 2023-02-11 09:54:38,741 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/a51b534ee40d486e8aad2c57cf47ba25 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/a51b534ee40d486e8aad2c57cf47ba25 2023-02-11 09:54:38,745 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/a51b534ee40d486e8aad2c57cf47ba25, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 09:54:38,746 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 832ms, sequenceid=13, compaction requested=true 2023-02-11 09:54:38,746 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:38,746 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:38,747 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:38,748 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,748 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:38,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:38,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6733a722[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:38,750 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:38,750 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,753 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:38,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:38,753 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,753 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:38,754 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:38,754 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:38,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:38,757 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:38,757 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:38,757 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:38,757 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,757 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:38,758 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,758 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:38,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,758 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:38,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:38,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,760 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:38,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:38,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:38,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:38,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:38,762 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:38,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:38,763 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:38,762 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,763 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,863 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:38,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:38,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:38,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:38,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,869 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:38,869 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:38,869 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:38,869 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:38,869 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,869 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,875 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,875 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:38,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:38,875 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:38,875 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,876 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,876 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:38,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:38,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:38,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:38,876 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:38,877 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:38,877 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:38,877 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:38,877 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:38,877 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:39,288 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205168f027552f942239887d7b110217297 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205168f027552f942239887d7b110217297 2023-02-11 09:54:39,694 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/5a2a37b87d754ba9be27d86ed4093be0 2023-02-11 09:54:39,699 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/5a2a37b87d754ba9be27d86ed4093be0 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/5a2a37b87d754ba9be27d86ed4093be0 2023-02-11 09:54:39,702 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/5a2a37b87d754ba9be27d86ed4093be0, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 09:54:39,703 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 826ms, sequenceid=17, compaction requested=true 2023-02-11 09:54:39,703 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:39,703 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:39,703 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:39,703 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:39,703 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,703 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:39,703 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:39,705 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,705 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:39,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:39,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9824c04[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:39,707 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:39,707 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,708 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,708 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:39,708 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:39,708 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:39,708 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,708 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:39,709 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,709 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:39,709 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:39,709 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:39,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:39,711 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:39,711 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:39,711 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:39,711 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,711 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:39,714 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,714 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:39,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,714 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:39,714 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,715 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,717 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:39,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:39,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:39,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:39,718 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:39,718 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:39,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:39,818 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:39,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:39,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:39,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:39,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,825 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:39,825 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:39,825 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:39,825 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:39,825 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,825 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:39,826 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:39,827 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:39,827 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,828 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:39,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:39,828 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:39,828 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:39,828 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:39,828 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:40,240 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f5aec4a52b534646aefec6105edd3a3d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228f5aec4a52b534646aefec6105edd3a3d 2023-02-11 09:54:40,528 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:54:40,645 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/00ab6f0c79d34b8f866cb65c29af1345 2023-02-11 09:54:40,650 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/00ab6f0c79d34b8f866cb65c29af1345 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/00ab6f0c79d34b8f866cb65c29af1345 2023-02-11 09:54:40,655 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/00ab6f0c79d34b8f866cb65c29af1345, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 09:54:40,655 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 827ms, sequenceid=21, compaction requested=true 2023-02-11 09:54:40,656 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:40,656 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:40,656 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:40,662 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,662 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:40,662 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,662 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:40,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:40,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:40,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a39d5a5[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:40,664 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:40,664 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,665 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,665 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:40,665 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:40,665 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:40,665 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,665 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:40,666 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:40,666 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:40,666 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,666 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:40,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:40,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:40,669 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:40,669 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:40,669 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:40,669 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,669 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:40,670 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,670 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,670 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:40,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:40,671 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:40,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,672 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:40,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,675 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,675 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:40,675 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:40,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:40,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:40,675 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:40,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 09:54:40,675 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:40,675 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,676 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:40,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:40,676 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:40,676 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:40,676 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,676 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,676 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,776 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:40,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:40,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,783 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:40,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:40,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:40,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:40,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:40,849 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:40,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:40,849 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:40,849 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:40,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:40,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,850 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:40,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:40,850 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:40,851 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:40,851 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:40,851 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:40,851 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:40,851 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:41,264 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123113da3aac06d0427db1075680a87b146e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123113da3aac06d0427db1075680a87b146e 2023-02-11 09:54:41,670 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/7e8993dd06394d58b57b72e2be223562 2023-02-11 09:54:41,674 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/7e8993dd06394d58b57b72e2be223562 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7e8993dd06394d58b57b72e2be223562 2023-02-11 09:54:41,679 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7e8993dd06394d58b57b72e2be223562, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 09:54:41,680 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 829ms, sequenceid=25, compaction requested=true 2023-02-11 09:54:41,680 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:41,680 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:41,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:41,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:41,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:41,680 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:41,682 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,682 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:41,682 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,682 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:41,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:41,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:41,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c79030e[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:41,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:41,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,686 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:41,686 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,686 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:41,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:41,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:41,687 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:41,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:41,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:41,690 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:41,690 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:41,690 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:41,690 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,690 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:41,691 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,691 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:41,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,692 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:41,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:41,692 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,693 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:41,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,695 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,695 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:41,695 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:41,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:41,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:41,695 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:41,695 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:41,695 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:41,695 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,696 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,696 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:41,696 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:41,696 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:41,696 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,796 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:41,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:41,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:41,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:41,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,801 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:41,801 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:41,801 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:41,801 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:41,802 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,802 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,804 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,804 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:41,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:41,805 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:41,805 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,805 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,806 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:41,806 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:41,806 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:41,806 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:41,806 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:41,806 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:42,218 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010124061a43c1d94b5081f0fafd98b6690f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010124061a43c1d94b5081f0fafd98b6690f 2023-02-11 09:54:42,624 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/c440a33a36f947249c31fac2ece675b4 2023-02-11 09:54:42,629 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/c440a33a36f947249c31fac2ece675b4 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/c440a33a36f947249c31fac2ece675b4 2023-02-11 09:54:42,633 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/c440a33a36f947249c31fac2ece675b4, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 09:54:42,634 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 828ms, sequenceid=29, compaction requested=true 2023-02-11 09:54:42,634 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:42,634 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:42,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:42,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:42,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:42,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:42,636 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,636 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:42,636 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,636 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:42,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:42,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2689b514[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:42,637 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:42,637 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,638 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,639 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:42,639 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:42,639 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:42,639 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,639 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:42,640 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:42,642 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:42,642 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:42,642 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:42,642 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,642 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:42,647 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,647 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,647 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:42,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:42,648 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,649 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,650 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,651 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:42,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:42,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:42,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:42,651 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:42,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:42,751 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:42,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:42,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:42,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:42,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,757 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:42,757 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:42,757 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:42,757 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:42,758 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,758 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,759 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:42,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:42,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:42,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:42,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:42,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:42,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,760 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,760 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:42,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:42,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:42,761 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:42,761 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:42,761 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:42,761 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:43,174 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031571ca33af804227a13a113669187046 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031571ca33af804227a13a113669187046 2023-02-11 09:54:43,579 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/7cf8d110f1324832ac56693b591ad730 2023-02-11 09:54:43,584 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/7cf8d110f1324832ac56693b591ad730 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7cf8d110f1324832ac56693b591ad730 2023-02-11 09:54:43,587 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7cf8d110f1324832ac56693b591ad730, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 09:54:43,588 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 827ms, sequenceid=33, compaction requested=true 2023-02-11 09:54:43,588 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:43,588 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:43,590 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,590 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:43,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:43,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3df02fad[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:43,592 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:43,592 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,594 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:43,594 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:43,594 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,594 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:43,596 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:43,596 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,596 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:43,596 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:43,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:43,598 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:43,598 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:43,598 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:43,598 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,598 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:43,599 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,599 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,599 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:43,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:43,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:43,600 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:43,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,601 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,603 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:43,603 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:43,704 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:43,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:43,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:43,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:43,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,710 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:43,710 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:43,710 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:43,710 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:43,710 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,710 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,712 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,712 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:43,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:43,713 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:43,713 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:43,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,713 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,714 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:43,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:43,714 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:43,714 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:43,714 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:43,714 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:43,714 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:43,714 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:43,714 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:43,714 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:44,126 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907869dda5b81b0403d9c40ba34e5e6ac43 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907869dda5b81b0403d9c40ba34e5e6ac43 2023-02-11 09:54:44,531 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/eb6a6bcadd874c5d9bd084ff49d0fa61 2023-02-11 09:54:44,536 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/eb6a6bcadd874c5d9bd084ff49d0fa61 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eb6a6bcadd874c5d9bd084ff49d0fa61 2023-02-11 09:54:44,540 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eb6a6bcadd874c5d9bd084ff49d0fa61, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 09:54:44,541 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 827ms, sequenceid=37, compaction requested=true 2023-02-11 09:54:44,541 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:44,541 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:44,543 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,543 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:44,543 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,543 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:44,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:44,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7920414b[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:44,544 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:44,544 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,545 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,546 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:44,546 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:44,546 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:44,546 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,546 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:44,547 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:44,547 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,547 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:44,547 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:44,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:44,549 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:44,549 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:44,549 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:44,549 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,549 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:44,551 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,551 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:44,551 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,552 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:44,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,553 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,558 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,558 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:44,558 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:44,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:44,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:44,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:44,558 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:44,558 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,558 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:44,558 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,559 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,559 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,559 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,559 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:44,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:44,559 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:44,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:44,659 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:44,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:44,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:44,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:44,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,665 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:44,665 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:44,665 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-11 09:54:44,665 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-11 09:54:44,666 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,666 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,667 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,667 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:44,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:44,667 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:44,667 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:44,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,668 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-11 09:54:44,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:44,668 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-11 09:54:44,668 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:44,668 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-11 09:54:44,668 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:44,669 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:44,669 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:44,669 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. started... 2023-02-11 09:54:44,669 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ee9d5c2deae1724621309680e97ab 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:45,082 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208fa65961f46c40b18c9a1712cfda0a41 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208fa65961f46c40b18c9a1712cfda0a41 2023-02-11 09:54:45,487 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/d310463eddc84951b0d2a7eb180fb816 2023-02-11 09:54:45,492 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/d310463eddc84951b0d2a7eb180fb816 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/d310463eddc84951b0d2a7eb180fb816 2023-02-11 09:54:45,495 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/d310463eddc84951b0d2a7eb180fb816, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 09:54:45,496 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ee9d5c2deae1724621309680e97ab in 827ms, sequenceid=41, compaction requested=true 2023-02-11 09:54:45,496 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:45,496 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-11 09:54:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-11 09:54:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,499 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:45,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-11 09:54:45,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dd55c12[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:45,500 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-11 09:54:45,500 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,501 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-11 09:54:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-11 09:54:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:45,501 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,501 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:45,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-11 09:54:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-11 09:54:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:45,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-11 09:54:45,504 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-11 09:54:45,505 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:45,505 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:45,505 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,505 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:45,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:45,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:45,507 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,508 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,510 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,510 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:45,510 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:45,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-11 09:54:45,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:45,510 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:45,510 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,510 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:45,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:45,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,511 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:45,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:45,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:45,511 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:45,611 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:45,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:45,613 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:45,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:45,615 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:45,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:45,616 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109885616 2023-02-11 09:54:45,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:54:45,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 09:54:45,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:45,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x1e606c42 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:54:45,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60e7de4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:54:45,624 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,458 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103648af2f5c01b4b4a8f018afa81a97460 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103648af2f5c01b4b4a8f018afa81a97460 2023-02-11 09:54:46,459 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:46,472 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:54:46,473 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44260, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:54:46,479 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:54:46,481 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:54:46,493 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/713dbe43a8374f6088ab9a60931c8d9c first=Optional[r3] last=Optional[r6] 2023-02-11 09:54:46,494 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/713dbe43a8374f6088ab9a60931c8d9c}] 2023-02-11 09:54:46,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/713dbe43a8374f6088ab9a60931c8d9c for inclusion in 006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:46,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 09:54:46,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:46,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:46,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/713dbe43a8374f6088ab9a60931c8d9c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__loco4uddnmmgh3b9i3feq48qq80837eai71gnqfavbep0j19a0kok4p7pn0ci7tj/family1/713dbe43a8374f6088ab9a60931c8d9c 2023-02-11 09:54:46,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__loco4uddnmmgh3b9i3feq48qq80837eai71gnqfavbep0j19a0kok4p7pn0ci7tj/family1/713dbe43a8374f6088ab9a60931c8d9c as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_ 2023-02-11 09:54:46,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__loco4uddnmmgh3b9i3feq48qq80837eai71gnqfavbep0j19a0kok4p7pn0ci7tj/family1/713dbe43a8374f6088ab9a60931c8d9c into 006ee9d5c2deae1724621309680e97ab/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_ - updating store file list. 2023-02-11 09:54:46,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_ into 006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:46,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__loco4uddnmmgh3b9i3feq48qq80837eai71gnqfavbep0j19a0kok4p7pn0ci7tj/family1/713dbe43a8374f6088ab9a60931c8d9c into 006ee9d5c2deae1724621309680e97ab/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_) 2023-02-11 09:54:46,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__loco4uddnmmgh3b9i3feq48qq80837eai71gnqfavbep0j19a0kok4p7pn0ci7tj/family1/713dbe43a8374f6088ab9a60931c8d9c 2023-02-11 09:54:46,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 09:54:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 09:54:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 006ee9d5c2deae1724621309680e97ab/family1 is initiating minor compaction 2023-02-11 09:54:46,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@27daa0cf; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:46,512 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 006ee9d5c2deae1724621309680e97ab/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:46,512 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/18b93fbc702546108a6d68b4b60be71a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/a51b534ee40d486e8aad2c57cf47ba25, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/5a2a37b87d754ba9be27d86ed4093be0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/00ab6f0c79d34b8f866cb65c29af1345, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7e8993dd06394d58b57b72e2be223562, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/c440a33a36f947249c31fac2ece675b4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7cf8d110f1324832ac56693b591ad730, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eb6a6bcadd874c5d9bd084ff49d0fa61, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/d310463eddc84951b0d2a7eb180fb816, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp, totalSize=50.4 K 2023-02-11 09:54:46,512 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 18b93fbc702546108a6d68b4b60be71a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting a51b534ee40d486e8aad2c57cf47ba25, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 5a2a37b87d754ba9be27d86ed4093be0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 00ab6f0c79d34b8f866cb65c29af1345, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 7e8993dd06394d58b57b72e2be223562, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c440a33a36f947249c31fac2ece675b4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 7cf8d110f1324832ac56693b591ad730, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting eb6a6bcadd874c5d9bd084ff49d0fa61, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting d310463eddc84951b0d2a7eb180fb816, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 09:54:46,513 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting eee80681e3af434d958440515a4a1971_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 09:54:46,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:46,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:46,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228f5aec4a52b534646aefec6105edd3a3d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228f5aec4a52b534646aefec6105edd3a3d 2023-02-11 09:54:46,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123113da3aac06d0427db1075680a87b146e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123113da3aac06d0427db1075680a87b146e 2023-02-11 09:54:46,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010124061a43c1d94b5081f0fafd98b6690f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010124061a43c1d94b5081f0fafd98b6690f 2023-02-11 09:54:46,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031571ca33af804227a13a113669187046 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601031571ca33af804227a13a113669187046 2023-02-11 09:54:46,520 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-11 09:54:46,520 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:46,539 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 006ee9d5c2deae1724621309680e97ab#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:47,356 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/6e831b3560e346148158a2bfd76a9d19 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/6e831b3560e346148158a2bfd76a9d19 2023-02-11 09:54:47,361 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 006ee9d5c2deae1724621309680e97ab/family1 of 006ee9d5c2deae1724621309680e97ab into 6e831b3560e346148158a2bfd76a9d19(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:54:47,361 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:47,361 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676109286512; duration=0sec 2023-02-11 09:54:47,361 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:47,372 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051b5f2cbcf19d4aefb1e5c7d016b1ff8f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512051b5f2cbcf19d4aefb1e5c7d016b1ff8f 2023-02-11 09:54:47,372 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:47,396 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a0fda11e967a412c93ddc25b8b903b39 first=Optional[r00] last=Optional[r2] 2023-02-11 09:54:47,396 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a0fda11e967a412c93ddc25b8b903b39}] 2023-02-11 09:54:47,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a0fda11e967a412c93ddc25b8b903b39 for inclusion in 006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:47,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 09:54:47,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:47,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:47,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a0fda11e967a412c93ddc25b8b903b39 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__p5ur4v7cl2uoa5ohnu6hhqbcfb3u5qq9nknpcr7pq6ghajvnmevgt69rc9qurnbd/family1/a0fda11e967a412c93ddc25b8b903b39 2023-02-11 09:54:47,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__p5ur4v7cl2uoa5ohnu6hhqbcfb3u5qq9nknpcr7pq6ghajvnmevgt69rc9qurnbd/family1/a0fda11e967a412c93ddc25b8b903b39 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_ 2023-02-11 09:54:47,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__p5ur4v7cl2uoa5ohnu6hhqbcfb3u5qq9nknpcr7pq6ghajvnmevgt69rc9qurnbd/family1/a0fda11e967a412c93ddc25b8b903b39 into 006ee9d5c2deae1724621309680e97ab/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_ - updating store file list. 2023-02-11 09:54:47,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_ into 006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:47,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__p5ur4v7cl2uoa5ohnu6hhqbcfb3u5qq9nknpcr7pq6ghajvnmevgt69rc9qurnbd/family1/a0fda11e967a412c93ddc25b8b903b39 into 006ee9d5c2deae1724621309680e97ab/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_) 2023-02-11 09:54:47,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__p5ur4v7cl2uoa5ohnu6hhqbcfb3u5qq9nknpcr7pq6ghajvnmevgt69rc9qurnbd/family1/a0fda11e967a412c93ddc25b8b903b39 2023-02-11 09:54:47,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 09:54:47,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 09:54:47,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 006ee9d5c2deae1724621309680e97ab/family1 is initiating minor compaction (all files) 2023-02-11 09:54:47,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@60ac75a2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:47,409 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 006ee9d5c2deae1724621309680e97ab/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:47,409 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/61dba3b8f44f49d7a85ffcf3baa3adcd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/6e831b3560e346148158a2bfd76a9d19, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp, totalSize=390.1 K 2023-02-11 09:54:47,409 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 61dba3b8f44f49d7a85ffcf3baa3adcd, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839484 2023-02-11 09:54:47,410 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 6e831b3560e346148158a2bfd76a9d19, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239484 2023-02-11 09:54:47,410 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting bd6c20e58d2745e8940fef3201365434_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839484 2023-02-11 09:54:47,410 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:47,411 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:47,413 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113041cf253f08e5452cab2c9bdd9e80742a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113041cf253f08e5452cab2c9bdd9e80742a 2023-02-11 09:54:47,414 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512015033664cc96d4259bb41fd16bd0b476c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512015033664cc96d4259bb41fd16bd0b476c 2023-02-11 09:54:47,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205168f027552f942239887d7b110217297 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205168f027552f942239887d7b110217297 2023-02-11 09:54:47,416 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-11 09:54:47,416 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 09:54:47,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:47,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:47,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:47,418 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:47,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8040 sec 2023-02-11 09:54:47,431 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 006ee9d5c2deae1724621309680e97ab#family1#compaction#62 average throughput is 16.42 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:54:47,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/18b93fbc702546108a6d68b4b60be71a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/a51b534ee40d486e8aad2c57cf47ba25, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/5a2a37b87d754ba9be27d86ed4093be0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/00ab6f0c79d34b8f866cb65c29af1345, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7e8993dd06394d58b57b72e2be223562, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/c440a33a36f947249c31fac2ece675b4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7cf8d110f1324832ac56693b591ad730, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eb6a6bcadd874c5d9bd084ff49d0fa61, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/d310463eddc84951b0d2a7eb180fb816, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_] to archive 2023-02-11 09:54:47,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:47,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/18b93fbc702546108a6d68b4b60be71a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/18b93fbc702546108a6d68b4b60be71a 2023-02-11 09:54:47,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/a51b534ee40d486e8aad2c57cf47ba25 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/a51b534ee40d486e8aad2c57cf47ba25 2023-02-11 09:54:47,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/5a2a37b87d754ba9be27d86ed4093be0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/5a2a37b87d754ba9be27d86ed4093be0 2023-02-11 09:54:47,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/00ab6f0c79d34b8f866cb65c29af1345 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/00ab6f0c79d34b8f866cb65c29af1345 2023-02-11 09:54:47,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7e8993dd06394d58b57b72e2be223562 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7e8993dd06394d58b57b72e2be223562 2023-02-11 09:54:47,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/c440a33a36f947249c31fac2ece675b4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/c440a33a36f947249c31fac2ece675b4 2023-02-11 09:54:47,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7cf8d110f1324832ac56693b591ad730 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/7cf8d110f1324832ac56693b591ad730 2023-02-11 09:54:47,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eb6a6bcadd874c5d9bd084ff49d0fa61 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eb6a6bcadd874c5d9bd084ff49d0fa61 2023-02-11 09:54:47,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/d310463eddc84951b0d2a7eb180fb816 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/d310463eddc84951b0d2a7eb180fb816 2023-02-11 09:54:47,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eee80681e3af434d958440515a4a1971_SeqId_44_ 2023-02-11 09:54:47,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 09:54:47,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:47,918 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 09:54:47,919 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-11 09:54:47,919 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 09:54:47,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-11 09:54:47,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE}] 2023-02-11 09:54:47,924 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE 2023-02-11 09:54:47,925 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:47,925 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109287925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109287925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109287925"}]},"ts":"1676109287925"} 2023-02-11 09:54:47,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:48,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 006ee9d5c2deae1724621309680e97ab, disabling compactions & flushes 2023-02-11 09:54:48,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,653 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/.tmp/family1/9b5bbddc0bb54792bb733f4328a46b3a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/9b5bbddc0bb54792bb733f4328a46b3a 2023-02-11 09:54:48,657 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 006ee9d5c2deae1724621309680e97ab/family1 of 006ee9d5c2deae1724621309680e97ab into 9b5bbddc0bb54792bb733f4328a46b3a(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:54:48,657 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:48,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,657 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676109287409; duration=1sec 2023-02-11 09:54:48,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. after waiting 0 ms 2023-02-11 09:54:48,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,658 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:54:48,658 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/61dba3b8f44f49d7a85ffcf3baa3adcd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/6e831b3560e346148158a2bfd76a9d19, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_] to archive 2023-02-11 09:54:48,658 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:48,660 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/61dba3b8f44f49d7a85ffcf3baa3adcd to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/61dba3b8f44f49d7a85ffcf3baa3adcd 2023-02-11 09:54:48,661 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/6e831b3560e346148158a2bfd76a9d19 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/6e831b3560e346148158a2bfd76a9d19 2023-02-11 09:54:48,662 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/bd6c20e58d2745e8940fef3201365434_SeqId_47_ 2023-02-11 09:54:48,666 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 09:54:48,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 006ee9d5c2deae1724621309680e97ab: Waiting for close lock at 1676109288078Running coprocessor pre-close hooks at 1676109288078Disabling compacts and flushes for region at 1676109288078Disabling writes for close at 1676109288658 (+580 ms)Writing region close event to WAL at 1676109288664 (+6 ms)Running coprocessor post-close hooks at 1676109288667 (+3 ms)Closed at 1676109288667 2023-02-11 09:54:48,667 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 006ee9d5c2deae1724621309680e97ab to self. 2023-02-11 09:54:48,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,669 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=CLOSED 2023-02-11 09:54:48,669 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109288669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109288669"}]},"ts":"1676109288669"} 2023-02-11 09:54:48,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-11 09:54:48,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499 in 744 msec 2023-02-11 09:54:48,672 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=true 2023-02-11 09:54:48,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:48,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109288822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109288822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109288822"}]},"ts":"1676109288822"} 2023-02-11 09:54:48,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:48,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 006ee9d5c2deae1724621309680e97ab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:54:48,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:48,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,980 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,981 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:48,981 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:48,981 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 006ee9d5c2deae1724621309680e97ab columnFamilyName family1 2023-02-11 09:54:48,985 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/9b5bbddc0bb54792bb733f4328a46b3a 2023-02-11 09:54:48,986 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(310): Store=006ee9d5c2deae1724621309680e97ab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:48,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:48,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 006ee9d5c2deae1724621309680e97ab; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61929980, jitterRate=-0.07717138528823853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:54:48,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 006ee9d5c2deae1724621309680e97ab: Running coprocessor pre-open hook at 1676109288979Writing region info on filesystem at 1676109288979Initializing all the Stores at 1676109288980 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676109288980Cleaning up temporary data from old regions at 1676109288988 (+8 ms)Cleaning up detritus from prior splits at 1676109288988Running coprocessor post-open hooks at 1676109288991 (+3 ms)Region opened successfully at 1676109288991 2023-02-11 09:54:48,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., pid=47, masterSystemTime=1676109288976 2023-02-11 09:54:48,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:48,993 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:48,993 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109288993"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109288993"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109288993"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109288993"}]},"ts":"1676109288993"} 2023-02-11 09:54:48,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-11 09:54:48,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499 in 170 msec 2023-02-11 09:54:48,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-11 09:54:48,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE in 1.0720 sec 2023-02-11 09:54:48,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-11 09:54:48,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0770 sec 2023-02-11 09:54:49,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4910 sec 2023-02-11 09:54:49,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-11 09:54:49,002 INFO [Listener at localhost/44465] compactions.TestMobCompactor(278): alter status finished 2023-02-11 09:54:49,003 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:49,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:49,005 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:49,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:49,006 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109889006 2023-02-11 09:54:49,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:54:49,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 09:54:49,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:49,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x7a878b71 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:54:49,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24cc2fd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:54:49,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,837 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128970eef70c965494d87038de93693cd92 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128970eef70c965494d87038de93693cd92 2023-02-11 09:54:49,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:49,850 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:54:49,851 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:54:49,857 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:54:49,858 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:54:49,866 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2569e6f2e03e4f579dae7c1c4d204ce7 first=Optional[r05] last=Optional[r8] 2023-02-11 09:54:49,866 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2569e6f2e03e4f579dae7c1c4d204ce7}] 2023-02-11 09:54:49,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2569e6f2e03e4f579dae7c1c4d204ce7 for inclusion in 006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:49,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 09:54:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:54:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 006ee9d5c2deae1724621309680e97ab: 2023-02-11 09:54:49,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2569e6f2e03e4f579dae7c1c4d204ce7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ugad89que8daiq77k030ob1dqt215t0jo9vt942s0ocq7jb2puvegs4oep7v637o/family1/2569e6f2e03e4f579dae7c1c4d204ce7 2023-02-11 09:54:49,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ugad89que8daiq77k030ob1dqt215t0jo9vt942s0ocq7jb2puvegs4oep7v637o/family1/2569e6f2e03e4f579dae7c1c4d204ce7 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eff25cfe4b2a4a2196422c054b1ff348_SeqId_53_ 2023-02-11 09:54:49,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ugad89que8daiq77k030ob1dqt215t0jo9vt942s0ocq7jb2puvegs4oep7v637o/family1/2569e6f2e03e4f579dae7c1c4d204ce7 into 006ee9d5c2deae1724621309680e97ab/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eff25cfe4b2a4a2196422c054b1ff348_SeqId_53_ - updating store file list. 2023-02-11 09:54:49,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eff25cfe4b2a4a2196422c054b1ff348_SeqId_53_ into 006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:49,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ugad89que8daiq77k030ob1dqt215t0jo9vt942s0ocq7jb2puvegs4oep7v637o/family1/2569e6f2e03e4f579dae7c1c4d204ce7 into 006ee9d5c2deae1724621309680e97ab/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eff25cfe4b2a4a2196422c054b1ff348_SeqId_53_) 2023-02-11 09:54:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ugad89que8daiq77k030ob1dqt215t0jo9vt942s0ocq7jb2puvegs4oep7v637o/family1/2569e6f2e03e4f579dae7c1c4d204ce7 2023-02-11 09:54:49,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:49,884 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:54:49,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208fa65961f46c40b18c9a1712cfda0a41 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208fa65961f46c40b18c9a1712cfda0a41 2023-02-11 09:54:49,887 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b2b0b17599a54f92a33c92e4c3c40e47 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b2b0b17599a54f92a33c92e4c3c40e47 2023-02-11 09:54:49,887 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-11 09:54:49,887 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 09:54:49,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:49,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:49,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:49,888 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:49,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 884 msec 2023-02-11 09:54:49,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 09:54:49,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:49,954 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-11 09:54:49,955 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-11 09:54:49,955 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-11 09:54:49,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-11 09:54:49,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE}] 2023-02-11 09:54:49,960 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE 2023-02-11 09:54:49,961 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:49,961 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109289961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109289961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109289961"}]},"ts":"1676109289961"} 2023-02-11 09:54:49,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:50,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 006ee9d5c2deae1724621309680e97ab, disabling compactions & flushes 2023-02-11 09:54:50,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:50,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:50,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. after waiting 0 ms 2023-02-11 09:54:50,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:50,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 09:54:50,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:50,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 006ee9d5c2deae1724621309680e97ab: Waiting for close lock at 1676109290115Running coprocessor pre-close hooks at 1676109290115Disabling compacts and flushes for region at 1676109290115Disabling writes for close at 1676109290115Writing region close event to WAL at 1676109290117 (+2 ms)Running coprocessor post-close hooks at 1676109290120 (+3 ms)Closed at 1676109290121 (+1 ms) 2023-02-11 09:54:50,121 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 006ee9d5c2deae1724621309680e97ab to self. 2023-02-11 09:54:50,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,123 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=CLOSED 2023-02-11 09:54:50,123 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109290123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109290123"}]},"ts":"1676109290123"} 2023-02-11 09:54:50,125 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-11 09:54:50,125 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499 in 162 msec 2023-02-11 09:54:50,125 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=true 2023-02-11 09:54:50,276 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:50,276 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109290276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109290276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109290276"}]},"ts":"1676109290276"} 2023-02-11 09:54:50,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:50,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:50,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 006ee9d5c2deae1724621309680e97ab, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:54:50,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:50,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,434 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,435 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:50,435 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1 2023-02-11 09:54:50,435 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 006ee9d5c2deae1724621309680e97ab columnFamilyName family1 2023-02-11 09:54:50,440 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/9b5bbddc0bb54792bb733f4328a46b3a 2023-02-11 09:54:50,443 DEBUG [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/family1/eff25cfe4b2a4a2196422c054b1ff348_SeqId_53_ 2023-02-11 09:54:50,443 INFO [StoreOpener-006ee9d5c2deae1724621309680e97ab-1] regionserver.HStore(310): Store=006ee9d5c2deae1724621309680e97ab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:50,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:54:50,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 006ee9d5c2deae1724621309680e97ab; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72886913, jitterRate=0.08609963953495026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:54:50,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 006ee9d5c2deae1724621309680e97ab: Running coprocessor pre-open hook at 1676109290433Writing region info on filesystem at 1676109290433Initializing all the Stores at 1676109290433Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676109290433Cleaning up temporary data from old regions at 1676109290445 (+12 ms)Cleaning up detritus from prior splits at 1676109290445Running coprocessor post-open hooks at 1676109290447 (+2 ms)Region opened successfully at 1676109290447 2023-02-11 09:54:50,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab., pid=53, masterSystemTime=1676109290429 2023-02-11 09:54:50,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:50,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:54:50,450 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=006ee9d5c2deae1724621309680e97ab, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:50,450 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676109290450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109290450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109290450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109290450"}]},"ts":"1676109290450"} 2023-02-11 09:54:50,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-11 09:54:50,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 006ee9d5c2deae1724621309680e97ab, server=jenkins-hbase4.apache.org,43463,1676109215499 in 173 msec 2023-02-11 09:54:50,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-11 09:54:50,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=006ee9d5c2deae1724621309680e97ab, REOPEN/MOVE in 493 msec 2023-02-11 09:54:50,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-11 09:54:50,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-02-11 09:54:50,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 511 msec 2023-02-11 09:54:50,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-11 09:54:50,457 INFO [Listener at localhost/44465] compactions.TestMobCompactor(278): alter status finished 2023-02-11 09:54:50,458 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-11 09:54:50,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:50,460 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:50,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:50,460 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109890460 2023-02-11 09:54:50,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:54:50,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-11 09:54:50,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:50,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x5d0d6a84 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:54:50,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18fa6441, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-11 09:54:50,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-11 09:54:50,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:54:50,468 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-11 09:54:50,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-02-11 09:54:50,531 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249 (was 257), OpenFileDescriptor=628 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 274), ProcessCount=174 (was 176), AvailableMemoryMB=2712 (was 2722) 2023-02-11 09:54:50,542 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=174, AvailableMemoryMB=2711 2023-02-11 09:54:50,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-11 09:54:50,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:50,545 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:54:50,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-11 09:54:50,546 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:54:50,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 09:54:50,547 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:54:50,547 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 empty. 2023-02-11 09:54:50,548 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:54:50,548 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-11 09:54:50,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 09:54:50,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 09:54:50,955 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-11 09:54:50,956 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9facb323010a262708498579be7487c4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:54:51,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 09:54:51,362 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:51,362 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 9facb323010a262708498579be7487c4, disabling compactions & flushes 2023-02-11 09:54:51,362 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:51,362 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:51,362 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. after waiting 0 ms 2023-02-11 09:54:51,362 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:51,362 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:51,362 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 9facb323010a262708498579be7487c4: Waiting for close lock at 1676109291362Disabling compacts and flushes for region at 1676109291362Disabling writes for close at 1676109291362Writing region close event to WAL at 1676109291362Closed at 1676109291362 2023-02-11 09:54:51,365 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:54:51,366 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109291366"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109291366"}]},"ts":"1676109291366"} 2023-02-11 09:54:51,367 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:54:51,367 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:54:51,368 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109291367"}]},"ts":"1676109291367"} 2023-02-11 09:54:51,369 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-11 09:54:51,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, ASSIGN}] 2023-02-11 09:54:51,374 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, ASSIGN 2023-02-11 09:54:51,375 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:54:51,526 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:51,526 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109291526"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109291526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109291526"}]},"ts":"1676109291526"} 2023-02-11 09:54:51,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:54:51,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 09:54:51,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:51,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9facb323010a262708498579be7487c4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:54:51,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 9facb323010a262708498579be7487c4 2023-02-11 09:54:51,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:54:51,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9facb323010a262708498579be7487c4 2023-02-11 09:54:51,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9facb323010a262708498579be7487c4 2023-02-11 09:54:51,683 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9facb323010a262708498579be7487c4 2023-02-11 09:54:51,684 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1 2023-02-11 09:54:51,684 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1 2023-02-11 09:54:51,684 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9facb323010a262708498579be7487c4 columnFamilyName family1 2023-02-11 09:54:51,685 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(310): Store=9facb323010a262708498579be7487c4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:54:51,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:54:51,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:54:51,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9facb323010a262708498579be7487c4 2023-02-11 09:54:51,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:54:51,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9facb323010a262708498579be7487c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72845897, jitterRate=0.0854884535074234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:54:51,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9facb323010a262708498579be7487c4: Running coprocessor pre-open hook at 1676109291682Writing region info on filesystem at 1676109291682Initializing all the Stores at 1676109291683 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676109291683Cleaning up temporary data from old regions at 1676109291687 (+4 ms)Cleaning up detritus from prior splits at 1676109291687Running coprocessor post-open hooks at 1676109291691 (+4 ms)Region opened successfully at 1676109291691 2023-02-11 09:54:51,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., pid=57, masterSystemTime=1676109291679 2023-02-11 09:54:51,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:51,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:51,694 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:51,694 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109291694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109291694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109291694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109291694"}]},"ts":"1676109291694"} 2023-02-11 09:54:51,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-11 09:54:51,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499 in 168 msec 2023-02-11 09:54:51,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-11 09:54:51,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, ASSIGN in 324 msec 2023-02-11 09:54:51,698 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:54:51,698 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109291698"}]},"ts":"1676109291698"} 2023-02-11 09:54:51,699 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-11 09:54:51,701 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:54:51,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1580 sec 2023-02-11 09:54:52,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-11 09:54:52,651 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-11 09:54:52,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:52,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,682 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:52,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:52,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:52,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:52,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,684 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:52,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:52,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:52,685 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:52,685 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:52,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,686 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:52,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:52,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:52,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:52,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:52,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:52,686 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:52,686 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:52,687 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 09:54:53,111 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f058a9ad28474ac1a0eab9177ea535b2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f058a9ad28474ac1a0eab9177ea535b2 2023-02-11 09:54:53,515 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/c5ccdfe0673741daaca88e6f7c6bcfbd 2023-02-11 09:54:53,519 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/c5ccdfe0673741daaca88e6f7c6bcfbd as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c5ccdfe0673741daaca88e6f7c6bcfbd 2023-02-11 09:54:53,523 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c5ccdfe0673741daaca88e6f7c6bcfbd, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-11 09:54:53,524 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 837ms, sequenceid=5, compaction requested=false 2023-02-11 09:54:53,524 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:53,525 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:53,525 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:53,525 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:53,527 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,527 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:53,527 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,527 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:53,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:53,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61f75a9[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:53,529 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:53,529 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,530 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:53,530 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:53,530 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,530 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:53,531 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:53,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:53,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:53,533 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:53,533 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:53,533 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:53,533 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,534 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:53,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:53,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,535 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:53,536 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,537 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,543 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:53,543 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,543 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:53,543 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,543 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:53,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:53,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:53,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:53,543 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,544 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,544 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,544 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,544 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:53,544 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:53,544 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:53,644 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:53,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:53,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:53,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:53,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,650 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:53,650 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:53,650 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:53,650 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:53,650 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,650 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,652 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:53,652 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:53,652 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:53,652 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:53,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,653 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:53,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,653 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,653 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:54:53,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:53,653 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:53,653 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:53,653 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:53,653 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:53,653 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:53,653 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:53,653 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:53,654 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 09:54:54,065 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b6f21f9bd5174c55864891755a044bf4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128b6f21f9bd5174c55864891755a044bf4 2023-02-11 09:54:54,202 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:54:54,473 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/85566d20d7024d139ff1a7c8f3c2f962 2023-02-11 09:54:54,478 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/85566d20d7024d139ff1a7c8f3c2f962 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/85566d20d7024d139ff1a7c8f3c2f962 2023-02-11 09:54:54,483 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/85566d20d7024d139ff1a7c8f3c2f962, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 09:54:54,483 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 830ms, sequenceid=9, compaction requested=false 2023-02-11 09:54:54,484 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:54,484 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:54,484 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:54,485 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,485 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:54,486 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,486 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:54,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:54,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:54,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a2ebf80[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:54,487 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:54,487 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,488 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:54,488 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:54,488 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,489 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:54,491 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:54,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:54,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:54,493 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:54,493 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:54,493 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:54,493 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,493 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:54,494 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,494 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,495 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:54,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:54,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,496 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:54,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:54,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:54,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 09:54:54,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:54,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:54,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:54,498 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:54,522 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d0d6a84 to 127.0.0.1:62294 2023-02-11 09:54:54,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,522 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:54,522 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:54,522 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:54,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:54,524 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:54,524 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a878b71 to 127.0.0.1:62294 2023-02-11 09:54:54,524 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:54,524 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:54,524 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e606c42 to 127.0.0.1:62294 2023-02-11 09:54:54,524 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:54,526 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:54,526 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x012985ba to 127.0.0.1:62294 2023-02-11 09:54:54,526 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:54,528 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:54:54,528 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fec6075 to 127.0.0.1:62294 2023-02-11 09:54:54,528 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:54:54,622 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:54,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:54,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:54,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:54,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,628 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:54,628 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:54,628 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:54,628 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:54,631 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,631 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,632 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,632 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:54,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:54,632 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:54,632 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,633 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:54,633 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:54,633 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:54,633 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:54,634 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:54,634 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:54,634 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:55,049 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e2e693e998a041b0a6b1d4c1297f36f9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201e2e693e998a041b0a6b1d4c1297f36f9 2023-02-11 09:54:55,454 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/bfba4d6808aa4c10ae5187174f7dddf4 2023-02-11 09:54:55,458 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/bfba4d6808aa4c10ae5187174f7dddf4 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/bfba4d6808aa4c10ae5187174f7dddf4 2023-02-11 09:54:55,462 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/bfba4d6808aa4c10ae5187174f7dddf4, entries=1, sequenceid=13, filesize=5.0 K 2023-02-11 09:54:55,463 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 829ms, sequenceid=13, compaction requested=true 2023-02-11 09:54:55,463 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:55,463 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:55,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:55,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:55,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:55,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:55,466 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,466 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:55,466 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,466 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:55,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:55,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:55,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@417f9b97[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:55,467 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:55,467 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,469 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,469 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:55,469 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:55,469 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:55,469 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,469 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:55,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:55,470 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:55,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:55,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:55,470 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:55,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:55,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:55,472 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:55,472 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:55,472 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:55,472 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,472 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:55,473 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,473 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:55,474 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,474 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:55,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,475 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:55,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:55,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:55,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:55,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:55,478 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:55,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:55,478 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:55,479 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:55,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,479 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,579 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:55,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:55,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:55,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:55,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,585 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:55,585 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:55,585 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:55,585 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:55,585 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,585 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,587 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:55,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:55,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:55,587 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:55,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,588 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,588 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:54:55,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:55,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:55,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:55,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:55,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:55,588 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:55,588 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:55,588 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:55,588 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:56,001 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053f08115df4954decaad53d4c0d5dc160 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053f08115df4954decaad53d4c0d5dc160 2023-02-11 09:54:56,406 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/c669065da30443669aadf0456122358d 2023-02-11 09:54:56,411 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/c669065da30443669aadf0456122358d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c669065da30443669aadf0456122358d 2023-02-11 09:54:56,414 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c669065da30443669aadf0456122358d, entries=1, sequenceid=17, filesize=5.0 K 2023-02-11 09:54:56,415 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 827ms, sequenceid=17, compaction requested=true 2023-02-11 09:54:56,415 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:56,415 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:56,415 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:56,415 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:56,415 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,415 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:56,415 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:56,424 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,424 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:56,424 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,424 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:56,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:56,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:56,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:56,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60d7a66[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:56,425 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:56,425 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,431 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,431 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:56,432 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:56,432 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:56,432 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,432 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:56,433 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:56,433 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:56,433 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,433 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:56,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:56,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:56,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:56,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:56,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:56,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:56,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:56,435 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:56,435 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:56,435 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:56,435 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,435 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:56,436 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,436 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:56,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:56,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,436 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:56,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:56,437 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:56,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,438 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:56,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,439 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,439 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,439 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:56,440 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:56,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:56,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:56,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:56,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:56,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:56,440 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:56,540 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:56,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:56,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:56,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:56,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,546 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:56,546 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:56,547 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:56,547 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:56,547 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,547 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,549 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:56,549 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:56,549 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:56,549 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:56,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,550 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,550 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:54:56,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:56,550 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:56,550 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:56,550 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:56,550 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:56,550 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:56,550 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:56,550 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:56,551 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:56,962 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283e61add706444221891b216cbb892464 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512283e61add706444221891b216cbb892464 2023-02-11 09:54:57,367 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/4a4e9e287b244044be881709872777cf 2023-02-11 09:54:57,371 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/4a4e9e287b244044be881709872777cf as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/4a4e9e287b244044be881709872777cf 2023-02-11 09:54:57,375 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/4a4e9e287b244044be881709872777cf, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 09:54:57,375 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 825ms, sequenceid=21, compaction requested=true 2023-02-11 09:54:57,375 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:57,375 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:57,375 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:57,375 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:57,375 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,376 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:57,376 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:57,377 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,377 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:57,377 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,377 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:57,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:57,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:57,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:57,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:57,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b42e533[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:57,379 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:57,379 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,380 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,380 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:57,380 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:57,380 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:57,380 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,380 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:57,381 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,381 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:57,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:57,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:57,381 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:57,381 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:57,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:57,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:57,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:57,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:57,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:57,383 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:57,383 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:57,383 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:57,383 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,383 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:57,386 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,386 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:57,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,386 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:57,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:57,386 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:57,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,387 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:57,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,389 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,389 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:57,389 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:57,389 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:57,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 09:54:57,389 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:57,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:57,389 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:57,389 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,390 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:57,390 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:57,390 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,390 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:57,390 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:57,490 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:57,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:57,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:57,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:57,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,495 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:57,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:57,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:57,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:57,496 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,496 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,497 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:57,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:57,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:57,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:57,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:57,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,498 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,498 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:54:57,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:57,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:57,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:57,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:57,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:57,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:57,498 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:57,498 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:57,498 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:57,910 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317446c1ef5da24e1eb21616583133d917 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512317446c1ef5da24e1eb21616583133d917 2023-02-11 09:54:58,316 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/c8b4d08a9910475985cb3026e2c2013d 2023-02-11 09:54:58,321 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/c8b4d08a9910475985cb3026e2c2013d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c8b4d08a9910475985cb3026e2c2013d 2023-02-11 09:54:58,325 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c8b4d08a9910475985cb3026e2c2013d, entries=1, sequenceid=25, filesize=5.0 K 2023-02-11 09:54:58,325 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 827ms, sequenceid=25, compaction requested=true 2023-02-11 09:54:58,325 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:58,326 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:58,326 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:58,326 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:58,326 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,326 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:58,326 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:58,327 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:58,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:58,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@345f8764[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:58,329 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:58,329 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,332 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,332 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:58,332 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:58,332 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:58,332 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,332 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:58,333 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:58,333 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:58,333 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,333 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:58,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:58,335 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:58,335 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:58,335 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:58,335 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,335 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:58,337 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,337 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,337 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:58,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:58,337 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:58,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,338 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:58,345 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:58,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:58,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:58,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 09:54:58,345 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:58,346 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:58,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:58,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:58,446 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:58,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:58,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:58,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:58,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,451 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:58,451 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:58,451 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:58,451 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:58,452 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,452 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,456 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:58,456 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:58,456 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:58,456 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:58,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:58,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,457 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:54:58,457 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:58,457 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:58,457 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:58,457 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:58,457 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:58,869 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010145afa91b28b443d4b79232fe5cbd2336 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010145afa91b28b443d4b79232fe5cbd2336 2023-02-11 09:54:59,275 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/ace70ca6b0544c27be85ef4991beb901 2023-02-11 09:54:59,279 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/ace70ca6b0544c27be85ef4991beb901 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/ace70ca6b0544c27be85ef4991beb901 2023-02-11 09:54:59,283 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/ace70ca6b0544c27be85ef4991beb901, entries=1, sequenceid=29, filesize=5.0 K 2023-02-11 09:54:59,283 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 826ms, sequenceid=29, compaction requested=true 2023-02-11 09:54:59,283 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:59,283 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:59,283 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:59,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:59,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:59,284 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:59,285 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,285 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:59,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:59,285 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,285 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:59,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:59,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:59,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:59,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:59,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9c1115b[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:59,287 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:59,287 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,289 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,289 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:59,289 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:59,289 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:59,289 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,289 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:59,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:59,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:59,290 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:59,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:59,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:59,292 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:59,292 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:59,292 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:59,292 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,292 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:59,293 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,293 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,294 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:59,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:59,294 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,295 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:59,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,297 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,297 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:59,297 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:59,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 09:54:59,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:59,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:59,298 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:59,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:59,298 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,398 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:59,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:59,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:59,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:59,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,405 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:59,405 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:59,405 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:59,405 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:59,405 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,405 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,407 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:59,407 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:59,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,408 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:59,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:54:59,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:59,409 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:59,409 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:59,410 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:54:59,429 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039347ba7df3f847d78c75b3d83f04141d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039347ba7df3f847d78c75b3d83f04141d 2023-02-11 09:54:59,835 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/437bec7976da45acbeec8d157cce3d0a 2023-02-11 09:54:59,839 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/437bec7976da45acbeec8d157cce3d0a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/437bec7976da45acbeec8d157cce3d0a 2023-02-11 09:54:59,842 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/437bec7976da45acbeec8d157cce3d0a, entries=1, sequenceid=33, filesize=5.0 K 2023-02-11 09:54:59,843 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 433ms, sequenceid=33, compaction requested=true 2023-02-11 09:54:59,843 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:54:59,843 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:54:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:54:59,843 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:54:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:54:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,845 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:54:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:59,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:59,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:59,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:54:59,847 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:54:59,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64f2944f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:54:59,847 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,848 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,848 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:54:59,848 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:54:59,848 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:54:59,848 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,848 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:54:59,849 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:54:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:59,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:59,849 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:54:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:59,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:59,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:54:59,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:54:59,851 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:54:59,851 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:54:59,851 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:54:59,851 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,851 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:54:59,857 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,857 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:54:59,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,857 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:54:59,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:59,858 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:54:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,859 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:54:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:59,861 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:54:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:59,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:59,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:54:59,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:54:59,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:54:59,862 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:54:59,861 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,962 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:54:59,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:54:59,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:54:59,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:54:59,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,967 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:54:59,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:59,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:54:59,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:54:59,968 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,968 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:54:59,969 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:54:59,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:54:59,969 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:54:59,969 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:54:59,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:54:59,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,970 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,970 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:54:59,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:54:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:54:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:54:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:54:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:54:59,970 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:54:59,970 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:54:59,971 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:54:59,971 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:55:00,383 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079c1f2cf073554eec81a6158dd122f73e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509079c1f2cf073554eec81a6158dd122f73e 2023-02-11 09:55:00,788 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/73b4826132ee4d40aa3c93f00bf55a7e 2023-02-11 09:55:00,792 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/73b4826132ee4d40aa3c93f00bf55a7e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/73b4826132ee4d40aa3c93f00bf55a7e 2023-02-11 09:55:00,796 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/73b4826132ee4d40aa3c93f00bf55a7e, entries=1, sequenceid=37, filesize=5.0 K 2023-02-11 09:55:00,796 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 825ms, sequenceid=37, compaction requested=true 2023-02-11 09:55:00,797 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:55:00,797 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:55:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:55:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:55:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:55:00,804 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,804 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,805 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:00,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:55:00,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f58e9f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:00,806 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:55:00,806 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,807 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:55:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:55:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:00,807 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,807 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:55:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:00,808 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:55:00,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:00,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:00,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:00,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:55:00,810 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:55:00,810 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:00,810 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:00,810 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,810 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:00,812 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,812 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:00,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,812 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:00,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:00,812 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,813 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:00,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:55:00,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:00,816 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:00,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:00,816 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,817 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,917 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:00,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:00,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:00,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:00,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,922 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:55:00,922 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:00,922 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-11 09:55:00,922 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-11 09:55:00,923 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,923 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,924 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:00,924 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:00,924 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:00,924 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,925 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,925 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-11 09:55:00,925 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-11 09:55:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-11 09:55:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:55:00,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:00,925 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:00,925 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. started... 2023-02-11 09:55:00,925 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9facb323010a262708498579be7487c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:55:01,338 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112086343821fddf4fe6b1d4185aeac5842f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112086343821fddf4fe6b1d4185aeac5842f 2023-02-11 09:55:01,745 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/9b0b4f8c661d43e98e02acf8ee9c6cab 2023-02-11 09:55:01,749 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/9b0b4f8c661d43e98e02acf8ee9c6cab as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/9b0b4f8c661d43e98e02acf8ee9c6cab 2023-02-11 09:55:01,752 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/9b0b4f8c661d43e98e02acf8ee9c6cab, entries=1, sequenceid=41, filesize=5.0 K 2023-02-11 09:55:01,753 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9facb323010a262708498579be7487c4 in 828ms, sequenceid=41, compaction requested=true 2023-02-11 09:55:01,753 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:55:01,753 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:01,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:55:01,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:55:01,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-11 09:55:01,753 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-11 09:55:01,755 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:01,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-11 09:55:01,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40d94c42[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:01,756 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-11 09:55:01,756 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,759 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-11 09:55:01,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-11 09:55:01,759 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:01,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,759 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:01,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-11 09:55:01,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:01,760 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,760 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-11 09:55:01,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:01,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:01,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-11 09:55:01,762 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-11 09:55:01,762 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:01,762 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:01,762 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,762 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:01,764 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,764 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:01,764 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:01,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:01,764 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:01,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,765 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:01,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-11 09:55:01,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:01,767 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:01,767 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,768 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:01,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:01,868 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:01,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:01,869 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:01,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:01,871 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:01,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:01,872 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109901872 2023-02-11 09:55:01,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:55:01,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 09:55:01,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:01,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x284a011d to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:01,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6031022e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:01,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,718 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103dac1beb2e6074cc087f77398b4183351 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103dac1beb2e6074cc087f77398b4183351 2023-02-11 09:55:02,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:02,731 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:02,732 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60704, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:02,738 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:55:02,739 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:55:02,746 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38cab6230c6e46cebad555c2285cb9bf first=Optional[r3] last=Optional[r6] 2023-02-11 09:55:02,746 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38cab6230c6e46cebad555c2285cb9bf}] 2023-02-11 09:55:02,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38cab6230c6e46cebad555c2285cb9bf for inclusion in 9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:02,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-11 09:55:02,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:55:02,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:55:02,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/38cab6230c6e46cebad555c2285cb9bf to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6fjfjbc8n92cc7sr9tpnsrvp6j6rguoc8panach14oh8mng0rvpod72r0mmn3d12/family1/38cab6230c6e46cebad555c2285cb9bf 2023-02-11 09:55:02,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6fjfjbc8n92cc7sr9tpnsrvp6j6rguoc8panach14oh8mng0rvpod72r0mmn3d12/family1/38cab6230c6e46cebad555c2285cb9bf as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_ 2023-02-11 09:55:02,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6fjfjbc8n92cc7sr9tpnsrvp6j6rguoc8panach14oh8mng0rvpod72r0mmn3d12/family1/38cab6230c6e46cebad555c2285cb9bf into 9facb323010a262708498579be7487c4/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_ - updating store file list. 2023-02-11 09:55:02,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_ into 9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:02,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6fjfjbc8n92cc7sr9tpnsrvp6j6rguoc8panach14oh8mng0rvpod72r0mmn3d12/family1/38cab6230c6e46cebad555c2285cb9bf into 9facb323010a262708498579be7487c4/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_) 2023-02-11 09:55:02,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__6fjfjbc8n92cc7sr9tpnsrvp6j6rguoc8panach14oh8mng0rvpod72r0mmn3d12/family1/38cab6230c6e46cebad555c2285cb9bf 2023-02-11 09:55:02,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 09:55:02,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 09:55:02,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 9facb323010a262708498579be7487c4/family1 is initiating minor compaction 2023-02-11 09:55:02,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@b7c6ceb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:55:02,761 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 9facb323010a262708498579be7487c4/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:02,761 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/85566d20d7024d139ff1a7c8f3c2f962, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/bfba4d6808aa4c10ae5187174f7dddf4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c669065da30443669aadf0456122358d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/4a4e9e287b244044be881709872777cf, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c8b4d08a9910475985cb3026e2c2013d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/ace70ca6b0544c27be85ef4991beb901, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/437bec7976da45acbeec8d157cce3d0a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/73b4826132ee4d40aa3c93f00bf55a7e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/9b0b4f8c661d43e98e02acf8ee9c6cab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp, totalSize=50.3 K 2023-02-11 09:55:02,761 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 85566d20d7024d139ff1a7c8f3c2f962, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting bfba4d6808aa4c10ae5187174f7dddf4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c669065da30443669aadf0456122358d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 4a4e9e287b244044be881709872777cf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c8b4d08a9910475985cb3026e2c2013d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting ace70ca6b0544c27be85ef4991beb901, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 437bec7976da45acbeec8d157cce3d0a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 73b4826132ee4d40aa3c93f00bf55a7e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 9b0b4f8c661d43e98e02acf8ee9c6cab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 09:55:02,762 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 09:55:02,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:02,763 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:02,765 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512283e61add706444221891b216cbb892464 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512283e61add706444221891b216cbb892464 2023-02-11 09:55:02,767 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512317446c1ef5da24e1eb21616583133d917 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512317446c1ef5da24e1eb21616583133d917 2023-02-11 09:55:02,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010145afa91b28b443d4b79232fe5cbd2336 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010145afa91b28b443d4b79232fe5cbd2336 2023-02-11 09:55:02,769 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039347ba7df3f847d78c75b3d83f04141d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039347ba7df3f847d78c75b3d83f04141d 2023-02-11 09:55:02,769 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-11 09:55:02,769 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:02,799 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9facb323010a262708498579be7487c4#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:03,222 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205895d42c7d29d46e3a37fad9708dfd86d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205895d42c7d29d46e3a37fad9708dfd86d 2023-02-11 09:55:03,223 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/3b62ca63f2a346468601d90c4e0be139 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/3b62ca63f2a346468601d90c4e0be139 2023-02-11 09:55:03,223 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:03,227 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9facb323010a262708498579be7487c4/family1 of 9facb323010a262708498579be7487c4 into 3b62ca63f2a346468601d90c4e0be139(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:03,227 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:55:03,227 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676109302761; duration=0sec 2023-02-11 09:55:03,227 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:55:03,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/85566d20d7024d139ff1a7c8f3c2f962, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/bfba4d6808aa4c10ae5187174f7dddf4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c669065da30443669aadf0456122358d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/4a4e9e287b244044be881709872777cf, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c8b4d08a9910475985cb3026e2c2013d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/ace70ca6b0544c27be85ef4991beb901, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/437bec7976da45acbeec8d157cce3d0a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/73b4826132ee4d40aa3c93f00bf55a7e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/9b0b4f8c661d43e98e02acf8ee9c6cab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_] to archive 2023-02-11 09:55:03,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:03,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/85566d20d7024d139ff1a7c8f3c2f962 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/85566d20d7024d139ff1a7c8f3c2f962 2023-02-11 09:55:03,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/bfba4d6808aa4c10ae5187174f7dddf4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/bfba4d6808aa4c10ae5187174f7dddf4 2023-02-11 09:55:03,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c669065da30443669aadf0456122358d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c669065da30443669aadf0456122358d 2023-02-11 09:55:03,261 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 first=Optional[r00] last=Optional[r2] 2023-02-11 09:55:03,262 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a8fa42e12fd4a6f9cdf085d90bb1885}] 2023-02-11 09:55:03,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/4a4e9e287b244044be881709872777cf to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/4a4e9e287b244044be881709872777cf 2023-02-11 09:55:03,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c8b4d08a9910475985cb3026e2c2013d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c8b4d08a9910475985cb3026e2c2013d 2023-02-11 09:55:03,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 for inclusion in 9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:03,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/ace70ca6b0544c27be85ef4991beb901 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/ace70ca6b0544c27be85ef4991beb901 2023-02-11 09:55:03,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/437bec7976da45acbeec8d157cce3d0a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/437bec7976da45acbeec8d157cce3d0a 2023-02-11 09:55:03,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-11 09:55:03,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:55:03,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:55:03,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/73b4826132ee4d40aa3c93f00bf55a7e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/73b4826132ee4d40aa3c93f00bf55a7e 2023-02-11 09:55:03,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e0m6q8nupql2gt979atb40ltqc5amat1lumseafhkpopcnggta30h3v3n7o59iu/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 2023-02-11 09:55:03,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/9b0b4f8c661d43e98e02acf8ee9c6cab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/9b0b4f8c661d43e98e02acf8ee9c6cab 2023-02-11 09:55:03,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/22c9c8fea26149b48b76fc8973ebcb48_SeqId_44_ 2023-02-11 09:55:03,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e0m6q8nupql2gt979atb40ltqc5amat1lumseafhkpopcnggta30h3v3n7o59iu/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_ 2023-02-11 09:55:03,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e0m6q8nupql2gt979atb40ltqc5amat1lumseafhkpopcnggta30h3v3n7o59iu/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 into 9facb323010a262708498579be7487c4/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_ - updating store file list. 2023-02-11 09:55:03,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_ into 9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:03,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e0m6q8nupql2gt979atb40ltqc5amat1lumseafhkpopcnggta30h3v3n7o59iu/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 into 9facb323010a262708498579be7487c4/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_) 2023-02-11 09:55:03,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__e0m6q8nupql2gt979atb40ltqc5amat1lumseafhkpopcnggta30h3v3n7o59iu/family1/3a8fa42e12fd4a6f9cdf085d90bb1885 2023-02-11 09:55:03,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-11 09:55:03,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-11 09:55:03,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 9facb323010a262708498579be7487c4/family1 is initiating minor compaction (all files) 2023-02-11 09:55:03,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6bc239ef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:55:03,280 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 9facb323010a262708498579be7487c4/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:03,280 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c5ccdfe0673741daaca88e6f7c6bcfbd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/3b62ca63f2a346468601d90c4e0be139, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp, totalSize=388.1 K 2023-02-11 09:55:03,280 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c5ccdfe0673741daaca88e6f7c6bcfbd, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839484 2023-02-11 09:55:03,281 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 3b62ca63f2a346468601d90c4e0be139, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239484 2023-02-11 09:55:03,282 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:03,282 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 1d88ceef64784f588968937868c15a4e_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878839484 2023-02-11 09:55:03,282 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:03,284 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f058a9ad28474ac1a0eab9177ea535b2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f058a9ad28474ac1a0eab9177ea535b2 2023-02-11 09:55:03,285 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201e2e693e998a041b0a6b1d4c1297f36f9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201e2e693e998a041b0a6b1d4c1297f36f9 2023-02-11 09:55:03,287 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053f08115df4954decaad53d4c0d5dc160 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053f08115df4954decaad53d4c0d5dc160 2023-02-11 09:55:03,287 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-11 09:55:03,287 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-11 09:55:03,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:03,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:03,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:03,289 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:03,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4190 sec 2023-02-11 09:55:03,301 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9facb323010a262708498579be7487c4#family1#compaction#74 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:03,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 09:55:03,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:03,764 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 09:55:03,765 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-11 09:55:03,765 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 09:55:03,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-11 09:55:03,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE}] 2023-02-11 09:55:03,770 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE 2023-02-11 09:55:03,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:03,771 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109303770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109303770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109303770"}]},"ts":"1676109303770"} 2023-02-11 09:55:03,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:03,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9facb323010a262708498579be7487c4 2023-02-11 09:55:03,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9facb323010a262708498579be7487c4, disabling compactions & flushes 2023-02-11 09:55:03,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,517 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/.tmp/family1/b177639e0d774623a469041f5422cf37 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/b177639e0d774623a469041f5422cf37 2023-02-11 09:55:04,521 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9facb323010a262708498579be7487c4/family1 of 9facb323010a262708498579be7487c4 into b177639e0d774623a469041f5422cf37(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:04,521 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:55:04,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,521 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676109303280; duration=1sec 2023-02-11 09:55:04,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. after waiting 0 ms 2023-02-11 09:55:04,521 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:55:04,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,524 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c5ccdfe0673741daaca88e6f7c6bcfbd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/3b62ca63f2a346468601d90c4e0be139, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_] to archive 2023-02-11 09:55:04,524 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:04,526 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c5ccdfe0673741daaca88e6f7c6bcfbd to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/c5ccdfe0673741daaca88e6f7c6bcfbd 2023-02-11 09:55:04,527 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/3b62ca63f2a346468601d90c4e0be139 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/3b62ca63f2a346468601d90c4e0be139 2023-02-11 09:55:04,528 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/1d88ceef64784f588968937868c15a4e_SeqId_47_ 2023-02-11 09:55:04,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 09:55:04,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9facb323010a262708498579be7487c4: Waiting for close lock at 1676109303923Running coprocessor pre-close hooks at 1676109303923Disabling compacts and flushes for region at 1676109303923Disabling writes for close at 1676109304521 (+598 ms)Writing region close event to WAL at 1676109304530 (+9 ms)Running coprocessor post-close hooks at 1676109304533 (+3 ms)Closed at 1676109304533 2023-02-11 09:55:04,533 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 9facb323010a262708498579be7487c4 to self. 2023-02-11 09:55:04,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9facb323010a262708498579be7487c4 2023-02-11 09:55:04,534 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=CLOSED 2023-02-11 09:55:04,534 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109304534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109304534"}]},"ts":"1676109304534"} 2023-02-11 09:55:04,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-11 09:55:04,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499 in 763 msec 2023-02-11 09:55:04,537 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=true 2023-02-11 09:55:04,687 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:04,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109304687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109304687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109304687"}]},"ts":"1676109304687"} 2023-02-11 09:55:04,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:04,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9facb323010a262708498579be7487c4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:55:04,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 9facb323010a262708498579be7487c4 2023-02-11 09:55:04,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:04,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9facb323010a262708498579be7487c4 2023-02-11 09:55:04,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9facb323010a262708498579be7487c4 2023-02-11 09:55:04,844 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9facb323010a262708498579be7487c4 2023-02-11 09:55:04,845 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:04,845 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:04,846 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9facb323010a262708498579be7487c4 columnFamilyName family1 2023-02-11 09:55:04,850 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/b177639e0d774623a469041f5422cf37 2023-02-11 09:55:04,850 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(310): Store=9facb323010a262708498579be7487c4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:04,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:55:04,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:55:04,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9facb323010a262708498579be7487c4 2023-02-11 09:55:04,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9facb323010a262708498579be7487c4; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73223908, jitterRate=0.09112125635147095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:55:04,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9facb323010a262708498579be7487c4: Running coprocessor pre-open hook at 1676109304843Writing region info on filesystem at 1676109304843Initializing all the Stores at 1676109304844 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676109304844Cleaning up temporary data from old regions at 1676109304852 (+8 ms)Cleaning up detritus from prior splits at 1676109304852Running coprocessor post-open hooks at 1676109304855 (+3 ms)Region opened successfully at 1676109304855 2023-02-11 09:55:04,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., pid=63, masterSystemTime=1676109304840 2023-02-11 09:55:04,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:04,857 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:04,857 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109304857"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109304857"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109304857"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109304857"}]},"ts":"1676109304857"} 2023-02-11 09:55:04,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-11 09:55:04,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499 in 169 msec 2023-02-11 09:55:04,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-11 09:55:04,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE in 1.0900 sec 2023-02-11 09:55:04,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-11 09:55:04,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0940 sec 2023-02-11 09:55:04,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5070 sec 2023-02-11 09:55:04,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-11 09:55:04,865 INFO [Listener at localhost/44465] compactions.TestMobCompactor(278): alter status finished 2023-02-11 09:55:04,866 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:04,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:04,867 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:04,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:04,868 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109904868 2023-02-11 09:55:04,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:55:04,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 09:55:04,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:04,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x4ecfd59d to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:04,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e296ad0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:04,874 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:04,874 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:04,874 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:04,874 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:04,874 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:05,696 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128199bca2217334e0a934821f0053ed481 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128199bca2217334e0a934821f0053ed481 2023-02-11 09:55:05,697 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:05,710 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:05,711 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:05,717 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:55:05,718 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57344, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:55:05,726 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/938c196a19214cf1bb16ed0b8d55af72 first=Optional[r05] last=Optional[r8] 2023-02-11 09:55:05,726 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/938c196a19214cf1bb16ed0b8d55af72}] 2023-02-11 09:55:05,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/938c196a19214cf1bb16ed0b8d55af72 for inclusion in 9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:05,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-11 09:55:05,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:55:05,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 9facb323010a262708498579be7487c4: 2023-02-11 09:55:05,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/938c196a19214cf1bb16ed0b8d55af72 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__imjinsjmetrq3401klp0nrmqc89u8suqu0aggcg080g7iscdvqa1mf16v82cidsi/family1/938c196a19214cf1bb16ed0b8d55af72 2023-02-11 09:55:05,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__imjinsjmetrq3401klp0nrmqc89u8suqu0aggcg080g7iscdvqa1mf16v82cidsi/family1/938c196a19214cf1bb16ed0b8d55af72 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/da7ab5c83bae4b37932f9a82701418f0_SeqId_53_ 2023-02-11 09:55:05,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__imjinsjmetrq3401klp0nrmqc89u8suqu0aggcg080g7iscdvqa1mf16v82cidsi/family1/938c196a19214cf1bb16ed0b8d55af72 into 9facb323010a262708498579be7487c4/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/da7ab5c83bae4b37932f9a82701418f0_SeqId_53_ - updating store file list. 2023-02-11 09:55:05,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/da7ab5c83bae4b37932f9a82701418f0_SeqId_53_ into 9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:05,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__imjinsjmetrq3401klp0nrmqc89u8suqu0aggcg080g7iscdvqa1mf16v82cidsi/family1/938c196a19214cf1bb16ed0b8d55af72 into 9facb323010a262708498579be7487c4/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/da7ab5c83bae4b37932f9a82701418f0_SeqId_53_) 2023-02-11 09:55:05,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__imjinsjmetrq3401klp0nrmqc89u8suqu0aggcg080g7iscdvqa1mf16v82cidsi/family1/938c196a19214cf1bb16ed0b8d55af72 2023-02-11 09:55:05,742 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:05,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:05,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112086343821fddf4fe6b1d4185aeac5842f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112086343821fddf4fe6b1d4185aeac5842f 2023-02-11 09:55:05,745 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128b6f21f9bd5174c55864891755a044bf4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128b6f21f9bd5174c55864891755a044bf4 2023-02-11 09:55:05,745 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-11 09:55:05,745 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 09:55:05,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:05,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:05,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:05,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:05,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:05,747 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:05,748 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 881 msec 2023-02-11 09:55:05,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-11 09:55:05,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:06,201 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-11 09:55:06,202 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-11 09:55:06,202 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-11 09:55:06,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-11 09:55:06,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE}] 2023-02-11 09:55:06,206 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE 2023-02-11 09:55:06,207 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:06,207 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109306207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109306207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109306207"}]},"ts":"1676109306207"} 2023-02-11 09:55:06,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:06,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9facb323010a262708498579be7487c4 2023-02-11 09:55:06,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9facb323010a262708498579be7487c4, disabling compactions & flushes 2023-02-11 09:55:06,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:06,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:06,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. after waiting 0 ms 2023-02-11 09:55:06,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:06,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-11 09:55:06,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:06,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9facb323010a262708498579be7487c4: Waiting for close lock at 1676109306360Running coprocessor pre-close hooks at 1676109306360Disabling compacts and flushes for region at 1676109306360Disabling writes for close at 1676109306360Writing region close event to WAL at 1676109306362 (+2 ms)Running coprocessor post-close hooks at 1676109306365 (+3 ms)Closed at 1676109306365 2023-02-11 09:55:06,365 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 9facb323010a262708498579be7487c4 to self. 2023-02-11 09:55:06,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9facb323010a262708498579be7487c4 2023-02-11 09:55:06,367 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=CLOSED 2023-02-11 09:55:06,367 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109306367"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109306367"}]},"ts":"1676109306367"} 2023-02-11 09:55:06,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-11 09:55:06,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499 in 160 msec 2023-02-11 09:55:06,369 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=true 2023-02-11 09:55:06,520 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:06,520 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109306519"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109306519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109306519"}]},"ts":"1676109306519"} 2023-02-11 09:55:06,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:06,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:06,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9facb323010a262708498579be7487c4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:55:06,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 9facb323010a262708498579be7487c4 2023-02-11 09:55:06,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:06,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9facb323010a262708498579be7487c4 2023-02-11 09:55:06,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9facb323010a262708498579be7487c4 2023-02-11 09:55:06,677 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9facb323010a262708498579be7487c4 2023-02-11 09:55:06,677 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:06,677 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1 2023-02-11 09:55:06,678 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9facb323010a262708498579be7487c4 columnFamilyName family1 2023-02-11 09:55:06,682 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/b177639e0d774623a469041f5422cf37 2023-02-11 09:55:06,685 DEBUG [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/family1/da7ab5c83bae4b37932f9a82701418f0_SeqId_53_ 2023-02-11 09:55:06,685 INFO [StoreOpener-9facb323010a262708498579be7487c4-1] regionserver.HStore(310): Store=9facb323010a262708498579be7487c4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:06,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:55:06,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4 2023-02-11 09:55:06,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9facb323010a262708498579be7487c4 2023-02-11 09:55:06,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9facb323010a262708498579be7487c4; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66307300, jitterRate=-0.011944234371185303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:55:06,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9facb323010a262708498579be7487c4: Running coprocessor pre-open hook at 1676109306676Writing region info on filesystem at 1676109306676Initializing all the Stores at 1676109306676Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676109306676Cleaning up temporary data from old regions at 1676109306687 (+11 ms)Cleaning up detritus from prior splits at 1676109306687Running coprocessor post-open hooks at 1676109306689 (+2 ms)Region opened successfully at 1676109306689 2023-02-11 09:55:06,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4., pid=69, masterSystemTime=1676109306673 2023-02-11 09:55:06,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:06,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:55:06,691 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=9facb323010a262708498579be7487c4, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:06,692 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676109306691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109306691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109306691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109306691"}]},"ts":"1676109306691"} 2023-02-11 09:55:06,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-11 09:55:06,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 9facb323010a262708498579be7487c4, server=jenkins-hbase4.apache.org,43463,1676109215499 in 172 msec 2023-02-11 09:55:06,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-11 09:55:06,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=9facb323010a262708498579be7487c4, REOPEN/MOVE in 488 msec 2023-02-11 09:55:06,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-11 09:55:06,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 492 msec 2023-02-11 09:55:06,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 905 msec 2023-02-11 09:55:06,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-11 09:55:06,701 INFO [Listener at localhost/44465] compactions.TestMobCompactor(278): alter status finished 2023-02-11 09:55:06,702 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-11 09:55:06,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:06,704 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:06,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:06,704 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109906704 2023-02-11 09:55:06,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:55:06,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-11 09:55:06,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:06,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x1f38fd7a to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:06,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@569f47f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-11 09:55:06,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-11 09:55:06,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:06,712 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-11 09:55:06,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-02-11 09:55:06,766 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=241 (was 249), OpenFileDescriptor=618 (was 628), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=174 (was 213), ProcessCount=175 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=2632 (was 2711) 2023-02-11 09:55:06,777 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=241, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=175, AvailableMemoryMB=2631 2023-02-11 09:55:06,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 09:55:06,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:06,781 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:55:06,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-11 09:55:06,782 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:55:06,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 09:55:06,783 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:06,783 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b empty. 2023-02-11 09:55:06,784 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:06,784 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-11 09:55:06,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 09:55:07,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 09:55:07,192 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-11 09:55:07,193 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => a65bb70872c18a7651a019d1a6ca565b, NAME => 'testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:07,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 09:55:07,598 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:07,598 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing a65bb70872c18a7651a019d1a6ca565b, disabling compactions & flushes 2023-02-11 09:55:07,598 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:07,599 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:07,599 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. after waiting 0 ms 2023-02-11 09:55:07,599 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:07,599 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:07,599 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for a65bb70872c18a7651a019d1a6ca565b: Waiting for close lock at 1676109307598Disabling compacts and flushes for region at 1676109307598Disabling writes for close at 1676109307599 (+1 ms)Writing region close event to WAL at 1676109307599Closed at 1676109307599 2023-02-11 09:55:07,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:55:07,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676109307601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109307601"}]},"ts":"1676109307601"} 2023-02-11 09:55:07,603 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:55:07,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:55:07,603 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109307603"}]},"ts":"1676109307603"} 2023-02-11 09:55:07,604 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-11 09:55:07,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a65bb70872c18a7651a019d1a6ca565b, ASSIGN}] 2023-02-11 09:55:07,608 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a65bb70872c18a7651a019d1a6ca565b, ASSIGN 2023-02-11 09:55:07,608 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=a65bb70872c18a7651a019d1a6ca565b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:07,759 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a65bb70872c18a7651a019d1a6ca565b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:07,759 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676109307759"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109307759"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109307759"}]},"ts":"1676109307759"} 2023-02-11 09:55:07,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure a65bb70872c18a7651a019d1a6ca565b, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:07,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 09:55:07,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:07,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a65bb70872c18a7651a019d1a6ca565b, NAME => 'testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:55:07,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-11 09:55:07,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-11 09:55:07,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:07,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:07,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:07,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:07,918 INFO [StoreOpener-a65bb70872c18a7651a019d1a6ca565b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:07,919 DEBUG [StoreOpener-a65bb70872c18a7651a019d1a6ca565b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1 2023-02-11 09:55:07,919 DEBUG [StoreOpener-a65bb70872c18a7651a019d1a6ca565b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1 2023-02-11 09:55:07,919 INFO [StoreOpener-a65bb70872c18a7651a019d1a6ca565b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a65bb70872c18a7651a019d1a6ca565b columnFamilyName f1 2023-02-11 09:55:07,921 INFO [StoreOpener-a65bb70872c18a7651a019d1a6ca565b-1] regionserver.HStore(310): Store=a65bb70872c18a7651a019d1a6ca565b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:07,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:07,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:07,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:07,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:07,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a65bb70872c18a7651a019d1a6ca565b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70346560, jitterRate=0.04824542999267578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:55:07,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a65bb70872c18a7651a019d1a6ca565b: Running coprocessor pre-open hook at 1676109307917Writing region info on filesystem at 1676109307917Initializing all the Stores at 1676109307917Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109307918 (+1 ms)Cleaning up temporary data from old regions at 1676109307922 (+4 ms)Cleaning up detritus from prior splits at 1676109307923 (+1 ms)Running coprocessor post-open hooks at 1676109307926 (+3 ms)Region opened successfully at 1676109307926 2023-02-11 09:55:07,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b., pid=73, masterSystemTime=1676109307912 2023-02-11 09:55:07,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:07,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:07,928 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a65bb70872c18a7651a019d1a6ca565b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:07,929 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676109307928"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109307928"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109307928"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109307928"}]},"ts":"1676109307928"} 2023-02-11 09:55:07,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-11 09:55:07,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure a65bb70872c18a7651a019d1a6ca565b, server=jenkins-hbase4.apache.org,43463,1676109215499 in 169 msec 2023-02-11 09:55:07,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-11 09:55:07,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=a65bb70872c18a7651a019d1a6ca565b, ASSIGN in 324 msec 2023-02-11 09:55:07,933 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:55:07,933 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109307933"}]},"ts":"1676109307933"} 2023-02-11 09:55:07,934 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-11 09:55:07,939 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:55:07,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1600 sec 2023-02-11 09:55:08,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-11 09:55:08,887 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-11 09:55:08,887 DEBUG [Listener at localhost/44465] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-11 09:55:08,889 INFO [Listener at localhost/44465] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 09:55:08,891 INFO [Listener at localhost/44465] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-11 09:55:08,892 INFO [Listener at localhost/44465] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 09:55:08,892 INFO [Listener at localhost/44465] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-11 09:55:08,895 INFO [Listener at localhost/44465] regionserver.HRegion(2744): Flushing a65bb70872c18a7651a019d1a6ca565b 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-11 09:55:09,306 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f631ef56c9ea42fc8ad8ca167c28d041 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211f631ef56c9ea42fc8ad8ca167c28d041 2023-02-11 09:55:09,712 INFO [Listener at localhost/44465] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/.tmp/f1/b11ec394d1a84954b6499c7f364a3b9a 2023-02-11 09:55:09,716 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/.tmp/f1/b11ec394d1a84954b6499c7f364a3b9a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a 2023-02-11 09:55:09,720 INFO [Listener at localhost/44465] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a, entries=1, sequenceid=5, filesize=4.9 K 2023-02-11 09:55:09,721 INFO [Listener at localhost/44465] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for a65bb70872c18a7651a019d1a6ca565b in 826ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:09,721 DEBUG [Listener at localhost/44465] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-11 09:55:09,722 DEBUG [Listener at localhost/44465] regionserver.HRegion(2445): Flush status journal for a65bb70872c18a7651a019d1a6ca565b: 2023-02-11 09:55:09,723 INFO [Listener at localhost/44465] regionserver.HRegion(2744): Flushing a65bb70872c18a7651a019d1a6ca565b 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-11 09:55:09,733 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021105a607ccf2d54f1d9e92fc7b644e822c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021105a607ccf2d54f1d9e92fc7b644e822c 2023-02-11 09:55:10,067 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:55:10,138 INFO [Listener at localhost/44465] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/.tmp/f1/be5972624609475687182bfc36f2c671 2023-02-11 09:55:10,143 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/.tmp/f1/be5972624609475687182bfc36f2c671 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671 2023-02-11 09:55:10,147 INFO [Listener at localhost/44465] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671, entries=1, sequenceid=9, filesize=4.9 K 2023-02-11 09:55:10,148 INFO [Listener at localhost/44465] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for a65bb70872c18a7651a019d1a6ca565b in 425ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:10,148 DEBUG [Listener at localhost/44465] regionserver.HRegion(2445): Flush status journal for a65bb70872c18a7651a019d1a6ca565b: 2023-02-11 09:55:10,149 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-11 09:55:10,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 09:55:10,151 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 09:55:10,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:10,151 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109910151 2023-02-11 09:55:10,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 09:55:10,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-11 09:55:10,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-11 09:55:10,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x4f7ff67c to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:10,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63f3d8ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:10,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testGetAfterCompaction' and column='f1' 2023-02-11 09:55:10,200 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,200 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,251 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,251 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,302 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,302 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,352 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,352 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,403 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,403 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,454 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,454 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,504 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,505 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,555 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,555 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,606 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,606 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,657 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,657 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,707 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,707 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,758 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,758 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,809 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,809 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,859 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,860 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,910 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,910 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,961 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,961 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:10,979 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302116b6f19a2907d4800a8bae05f033d2fe7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302116b6f19a2907d4800a8bae05f033d2fe7 2023-02-11 09:55:10,979 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testGetAfterCompaction' column='f1' 2023-02-11 09:55:10,992 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:10,993 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33400, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:10,998 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:55:11,000 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:55:11,007 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/db96db6a240d43fa8c1f7eda393f8e56 first=Optional[r1] last=Optional[r2] 2023-02-11 09:55:11,008 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{f1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/db96db6a240d43fa8c1f7eda393f8e56}] 2023-02-11 09:55:11,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/db96db6a240d43fa8c1f7eda393f8e56 for inclusion in a65bb70872c18a7651a019d1a6ca565b/f1 2023-02-11 09:55:11,012 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,012 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-11 09:55:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:55:11,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for a65bb70872c18a7651a019d1a6ca565b: 2023-02-11 09:55:11,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/f1/db96db6a240d43fa8c1f7eda393f8e56 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testGetAfterCompaction__p0h06r2eme6ndeugbm65bdud9fi24h1fvi3u2ihuf4f6ltcn0p0cvemjs1j9fd1h/f1/db96db6a240d43fa8c1f7eda393f8e56 2023-02-11 09:55:11,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testGetAfterCompaction__p0h06r2eme6ndeugbm65bdud9fi24h1fvi3u2ihuf4f6ltcn0p0cvemjs1j9fd1h/f1/db96db6a240d43fa8c1f7eda393f8e56 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_ 2023-02-11 09:55:11,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testGetAfterCompaction__p0h06r2eme6ndeugbm65bdud9fi24h1fvi3u2ihuf4f6ltcn0p0cvemjs1j9fd1h/f1/db96db6a240d43fa8c1f7eda393f8e56 into a65bb70872c18a7651a019d1a6ca565b/f1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_ - updating store file list. 2023-02-11 09:55:11,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_ into a65bb70872c18a7651a019d1a6ca565b/f1 2023-02-11 09:55:11,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testGetAfterCompaction__p0h06r2eme6ndeugbm65bdud9fi24h1fvi3u2ihuf4f6ltcn0p0cvemjs1j9fd1h/f1/db96db6a240d43fa8c1f7eda393f8e56 into a65bb70872c18a7651a019d1a6ca565b/f1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_) 2023-02-11 09:55:11,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testGetAfterCompaction__p0h06r2eme6ndeugbm65bdud9fi24h1fvi3u2ihuf4f6ltcn0p0cvemjs1j9fd1h/f1/db96db6a240d43fa8c1f7eda393f8e56 2023-02-11 09:55:11,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): a65bb70872c18a7651a019d1a6ca565b/f1 is initiating minor compaction 2023-02-11 09:55:11,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f5a222e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:55:11,021 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a65bb70872c18a7651a019d1a6ca565b/f1 in testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:11,021 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/.tmp, totalSize=10.0 K 2023-02-11 09:55:11,021 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting be5972624609475687182bfc36f2c671, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:55:11,021 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 806f8706fd3742a98070b97a94477f58_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:55:11,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testGetAfterCompaction' column='f1' 2023-02-11 09:55:11,024 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:11,025 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021105a607ccf2d54f1d9e92fc7b644e822c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021105a607ccf2d54f1d9e92fc7b644e822c 2023-02-11 09:55:11,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211f631ef56c9ea42fc8ad8ca167c28d041 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230211f631ef56c9ea42fc8ad8ca167c28d041 2023-02-11 09:55:11,026 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-11 09:55:11,026 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 09:55:11,027 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testGetAfterCompaction' and column='f1' 2023-02-11 09:55:11,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-11 09:55:11,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:55:11,028 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-11 09:55:11,029 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): a65bb70872c18a7651a019d1a6ca565b#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:11,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 878 msec 2023-02-11 09:55:11,062 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,063 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,063 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,066 DEBUG [Listener at localhost/44465] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 09:55:11,070 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 09:55:11,070 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43463] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:11,071 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-11 09:55:11,071 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 09:55:11,071 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43463] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 09:55:11,071 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43463] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. because compaction request was cancelled 2023-02-11 09:55:11,122 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,123 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,123 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,173 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,174 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,174 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,224 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,225 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,225 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,275 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,276 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,276 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,326 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,327 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,327 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,377 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,377 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,377 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,428 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,428 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,428 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,479 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,479 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,479 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,530 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,530 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,530 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,581 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,581 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,581 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,632 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,632 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,632 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,683 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,683 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,683 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,734 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,734 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,734 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,784 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,784 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,785 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,835 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,835 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,835 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,841 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/.tmp/f1/0f9802b67de3441e81eeca32eeca2218 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/0f9802b67de3441e81eeca32eeca2218 2023-02-11 09:55:11,845 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in a65bb70872c18a7651a019d1a6ca565b/f1 of a65bb70872c18a7651a019d1a6ca565b into 0f9802b67de3441e81eeca32eeca2218(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:11,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a65bb70872c18a7651a019d1a6ca565b: 2023-02-11 09:55:11,845 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676109311021; duration=0sec 2023-02-11 09:55:11,845 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:55:11,886 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/0f9802b67de3441e81eeca32eeca2218; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676109311837; access_time=1676109311026; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,886 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,886 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,886 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,937 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/0f9802b67de3441e81eeca32eeca2218; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676109311837; access_time=1676109311026; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,937 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676109310975; access_time=1676109310167; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-11 09:55:11,937 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,937 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109310138; access_time=1676109309725; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_] to archive 2023-02-11 09:55:11,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:11,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/be5972624609475687182bfc36f2c671 2023-02-11 09:55:11,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/806f8706fd3742a98070b97a94477f58_SeqId_12_ 2023-02-11 09:55:11,987 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/0f9802b67de3441e81eeca32eeca2218; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676109311837; access_time=1676109311026; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:11,987 INFO [Listener at localhost/44465] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676109309711; access_time=1676109308897; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-11 09:55:12,107 INFO [Listener at localhost/44465] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-11 09:55:12,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-11 09:55:12,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:12,119 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109312119"}]},"ts":"1676109312119"} 2023-02-11 09:55:12,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 09:55:12,120 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-11 09:55:12,122 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-11 09:55:12,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a65bb70872c18a7651a019d1a6ca565b, UNASSIGN}] 2023-02-11 09:55:12,124 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=a65bb70872c18a7651a019d1a6ca565b, UNASSIGN 2023-02-11 09:55:12,124 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a65bb70872c18a7651a019d1a6ca565b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:12,125 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676109312124"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109312124"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109312124"}]},"ts":"1676109312124"} 2023-02-11 09:55:12,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure a65bb70872c18a7651a019d1a6ca565b, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:12,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 09:55:12,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:12,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a65bb70872c18a7651a019d1a6ca565b, disabling compactions & flushes 2023-02-11 09:55:12,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:12,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:12,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. after waiting 0 ms 2023-02-11 09:55:12,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:12,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-11 09:55:12,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-11 09:55:12,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b. 2023-02-11 09:55:12,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a65bb70872c18a7651a019d1a6ca565b: Waiting for close lock at 1676109312277Running coprocessor pre-close hooks at 1676109312277Disabling compacts and flushes for region at 1676109312277Disabling writes for close at 1676109312277Writing region close event to WAL at 1676109312278 (+1 ms)Running coprocessor post-close hooks at 1676109312281 (+3 ms)Closed at 1676109312282 (+1 ms) 2023-02-11 09:55:12,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:12,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a65bb70872c18a7651a019d1a6ca565b, regionState=CLOSED 2023-02-11 09:55:12,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676109312284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109312284"}]},"ts":"1676109312284"} 2023-02-11 09:55:12,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-11 09:55:12,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure a65bb70872c18a7651a019d1a6ca565b, server=jenkins-hbase4.apache.org,43463,1676109215499 in 159 msec 2023-02-11 09:55:12,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-11 09:55:12,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=a65bb70872c18a7651a019d1a6ca565b, UNASSIGN in 163 msec 2023-02-11 09:55:12,288 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109312288"}]},"ts":"1676109312288"} 2023-02-11 09:55:12,289 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-11 09:55:12,294 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-11 09:55:12,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-02-11 09:55:12,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-11 09:55:12,422 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-11 09:55:12,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-11 09:55:12,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:12,433 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:12,435 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:12,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-11 09:55:12,437 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:12,439 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1, FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/recovered.edits] 2023-02-11 09:55:12,442 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/0f9802b67de3441e81eeca32eeca2218 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/0f9802b67de3441e81eeca32eeca2218 2023-02-11 09:55:12,443 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/f1/b11ec394d1a84954b6499c7f364a3b9a 2023-02-11 09:55:12,445 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/recovered.edits/15.seqid to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b/recovered.edits/15.seqid 2023-02-11 09:55:12,446 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testGetAfterCompaction/a65bb70872c18a7651a019d1a6ca565b 2023-02-11 09:55:12,446 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-11 09:55:12,446 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-11 09:55:12,447 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-11 09:55:12,449 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302116b6f19a2907d4800a8bae05f033d2fe7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302116b6f19a2907d4800a8bae05f033d2fe7 2023-02-11 09:55:12,450 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-11 09:55:12,451 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:12,472 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-11 09:55:12,474 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-11 09:55:12,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:12,475 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-11 09:55:12,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676109312475"}]},"ts":"9223372036854775807"} 2023-02-11 09:55:12,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 09:55:12,476 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a65bb70872c18a7651a019d1a6ca565b, NAME => 'testGetAfterCompaction,,1676109306779.a65bb70872c18a7651a019d1a6ca565b.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 09:55:12,476 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-11 09:55:12,476 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676109312476"}]},"ts":"9223372036854775807"} 2023-02-11 09:55:12,478 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-11 09:55:12,479 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-11 09:55:12,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 52 msec 2023-02-11 09:55:12,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-11 09:55:12,536 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-11 09:55:12,549 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=247 (was 241) - Thread LEAK? -, OpenFileDescriptor=624 (was 618) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 174), ProcessCount=174 (was 175), AvailableMemoryMB=2616 (was 2631) 2023-02-11 09:55:12,559 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=247, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=174, AvailableMemoryMB=2616 2023-02-11 09:55:12,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 09:55:12,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-11 09:55:12,563 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:55:12,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-11 09:55:12,563 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:55:12,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 09:55:12,565 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720 2023-02-11 09:55:12,565 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:12,565 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:12,566 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720 empty. 2023-02-11 09:55:12,566 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e empty. 2023-02-11 09:55:12,566 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a empty. 2023-02-11 09:55:12,566 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720 2023-02-11 09:55:12,566 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:12,566 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:12,566 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-11 09:55:12,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 09:55:12,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 09:55:12,974 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-11 09:55:12,975 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => ffaa59391868e3b78654a134d119206a, NAME => 'testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:12,975 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => b9e6247c3c7f22b5fe2c5b9ec537ba6e, NAME => 'testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:12,975 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 016732cf600178157bb892db15fc6720, NAME => 'testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:13,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 09:55:13,384 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:13,384 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:13,384 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 016732cf600178157bb892db15fc6720, disabling compactions & flushes 2023-02-11 09:55:13,384 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:13,384 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:13,384 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing ffaa59391868e3b78654a134d119206a, disabling compactions & flushes 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing b9e6247c3c7f22b5fe2c5b9ec537ba6e, disabling compactions & flushes 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. after waiting 0 ms 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:13,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:13,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:13,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 016732cf600178157bb892db15fc6720: Waiting for close lock at 1676109313384Disabling compacts and flushes for region at 1676109313384Disabling writes for close at 1676109313385 (+1 ms)Writing region close event to WAL at 1676109313385Closed at 1676109313385 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. after waiting 0 ms 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. after waiting 0 ms 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:13,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:13,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for ffaa59391868e3b78654a134d119206a: Waiting for close lock at 1676109313384Disabling compacts and flushes for region at 1676109313384Disabling writes for close at 1676109313385 (+1 ms)Writing region close event to WAL at 1676109313385Closed at 1676109313385 2023-02-11 09:55:13,385 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: Waiting for close lock at 1676109313385Disabling compacts and flushes for region at 1676109313385Disabling writes for close at 1676109313385Writing region close event to WAL at 1676109313385Closed at 1676109313385 2023-02-11 09:55:13,387 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:55:13,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109313388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109313388"}]},"ts":"1676109313388"} 2023-02-11 09:55:13,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109313388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109313388"}]},"ts":"1676109313388"} 2023-02-11 09:55:13,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109313388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109313388"}]},"ts":"1676109313388"} 2023-02-11 09:55:13,390 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 09:55:13,390 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:55:13,390 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109313390"}]},"ts":"1676109313390"} 2023-02-11 09:55:13,391 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-11 09:55:13,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN}] 2023-02-11 09:55:13,397 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN 2023-02-11 09:55:13,397 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN 2023-02-11 09:55:13,397 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN 2023-02-11 09:55:13,398 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:13,398 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:13,398 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:13,549 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=016732cf600178157bb892db15fc6720, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:13,549 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=ffaa59391868e3b78654a134d119206a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:13,549 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b9e6247c3c7f22b5fe2c5b9ec537ba6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:13,550 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109313549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109313549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109313549"}]},"ts":"1676109313549"} 2023-02-11 09:55:13,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109313549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109313549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109313549"}]},"ts":"1676109313549"} 2023-02-11 09:55:13,550 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109313549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109313549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109313549"}]},"ts":"1676109313549"} 2023-02-11 09:55:13,551 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure ffaa59391868e3b78654a134d119206a, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:13,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure b9e6247c3c7f22b5fe2c5b9ec537ba6e, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:13,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 016732cf600178157bb892db15fc6720, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:13,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 09:55:13,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:13,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b9e6247c3c7f22b5fe2c5b9ec537ba6e, NAME => 'testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 09:55:13,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:13,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,707 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,709 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:13,709 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:13,709 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9e6247c3c7f22b5fe2c5b9ec537ba6e columnFamilyName family1 2023-02-11 09:55:13,710 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(310): Store=b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:13,710 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,711 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 2023-02-11 09:55:13,712 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 2023-02-11 09:55:13,712 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9e6247c3c7f22b5fe2c5b9ec537ba6e columnFamilyName family2 2023-02-11 09:55:13,713 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(310): Store=b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:13,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:13,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:13,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b9e6247c3c7f22b5fe2c5b9ec537ba6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59138623, jitterRate=-0.11876584589481354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:13,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: Running coprocessor pre-open hook at 1676109313707Writing region info on filesystem at 1676109313707Initializing all the Stores at 1676109313707Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109313707Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109313707Cleaning up temporary data from old regions at 1676109313715 (+8 ms)Cleaning up detritus from prior splits at 1676109313715Running coprocessor post-open hooks at 1676109313719 (+4 ms)Region opened successfully at 1676109313719 2023-02-11 09:55:13,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e., pid=84, masterSystemTime=1676109313704 2023-02-11 09:55:13,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:13,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:13,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:13,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 016732cf600178157bb892db15fc6720, NAME => 'testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 09:55:13,721 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b9e6247c3c7f22b5fe2c5b9ec537ba6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:13,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,721 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109313721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109313721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109313721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109313721"}]},"ts":"1676109313721"} 2023-02-11 09:55:13,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:13,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,722 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,724 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:13,724 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:13,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-11 09:55:13,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure b9e6247c3c7f22b5fe2c5b9ec537ba6e, server=jenkins-hbase4.apache.org,43463,1676109215499 in 171 msec 2023-02-11 09:55:13,724 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 016732cf600178157bb892db15fc6720 columnFamilyName family1 2023-02-11 09:55:13,725 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(310): Store=016732cf600178157bb892db15fc6720/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:13,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN in 329 msec 2023-02-11 09:55:13,725 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,726 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2 2023-02-11 09:55:13,726 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2 2023-02-11 09:55:13,726 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 016732cf600178157bb892db15fc6720 columnFamilyName family2 2023-02-11 09:55:13,727 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(310): Store=016732cf600178157bb892db15fc6720/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:13,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:13,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 016732cf600178157bb892db15fc6720 2023-02-11 09:55:13,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:13,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 016732cf600178157bb892db15fc6720; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71322074, jitterRate=0.06278172135353088}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:13,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 016732cf600178157bb892db15fc6720: Running coprocessor pre-open hook at 1676109313722Writing region info on filesystem at 1676109313722Initializing all the Stores at 1676109313722Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109313722Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109313722Cleaning up temporary data from old regions at 1676109313729 (+7 ms)Cleaning up detritus from prior splits at 1676109313729Running coprocessor post-open hooks at 1676109313733 (+4 ms)Region opened successfully at 1676109313733 2023-02-11 09:55:13,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720., pid=85, masterSystemTime=1676109313704 2023-02-11 09:55:13,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:13,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:13,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:13,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ffaa59391868e3b78654a134d119206a, NAME => 'testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 09:55:13,735 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=016732cf600178157bb892db15fc6720, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:13,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:13,735 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109313735"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109313735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109313735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109313735"}]},"ts":"1676109313735"} 2023-02-11 09:55:13,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,736 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,737 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:13,737 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:13,738 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffaa59391868e3b78654a134d119206a columnFamilyName family1 2023-02-11 09:55:13,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-02-11 09:55:13,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 016732cf600178157bb892db15fc6720, server=jenkins-hbase4.apache.org,43463,1676109215499 in 184 msec 2023-02-11 09:55:13,738 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(310): Store=ffaa59391868e3b78654a134d119206a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:13,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN in 343 msec 2023-02-11 09:55:13,739 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,740 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2 2023-02-11 09:55:13,740 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2 2023-02-11 09:55:13,740 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffaa59391868e3b78654a134d119206a columnFamilyName family2 2023-02-11 09:55:13,741 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(310): Store=ffaa59391868e3b78654a134d119206a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:13,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:13,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:13,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:13,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ffaa59391868e3b78654a134d119206a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61031361, jitterRate=-0.09056185185909271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:13,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ffaa59391868e3b78654a134d119206a: Running coprocessor pre-open hook at 1676109313735Writing region info on filesystem at 1676109313735Initializing all the Stores at 1676109313736 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109313736Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109313736Cleaning up temporary data from old regions at 1676109313742 (+6 ms)Cleaning up detritus from prior splits at 1676109313742Running coprocessor post-open hooks at 1676109313746 (+4 ms)Region opened successfully at 1676109313746 2023-02-11 09:55:13,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a., pid=83, masterSystemTime=1676109313704 2023-02-11 09:55:13,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:13,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:13,748 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=ffaa59391868e3b78654a134d119206a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:13,748 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109313748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109313748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109313748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109313748"}]},"ts":"1676109313748"} 2023-02-11 09:55:13,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-02-11 09:55:13,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure ffaa59391868e3b78654a134d119206a, server=jenkins-hbase4.apache.org,43463,1676109215499 in 198 msec 2023-02-11 09:55:13,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-02-11 09:55:13,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN in 354 msec 2023-02-11 09:55:13,752 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:55:13,752 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109313752"}]},"ts":"1676109313752"} 2023-02-11 09:55:13,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-11 09:55:13,757 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:55:13,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1960 sec 2023-02-11 09:55:14,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-11 09:55:14,668 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-11 09:55:14,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:14,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:14,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:14,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:14,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 09:55:14,682 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 09:55:14,682 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:14,682 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 09:55:14,682 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 09:55:14,682 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:14,682 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:14,683 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:14,683 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:14,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:14,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:14,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:14,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:14,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:14,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:14,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:14,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:14,684 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 09:55:14,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 09:55:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 09:55:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 09:55:14,685 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:14,685 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. started... 2023-02-11 09:55:14,685 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:14,685 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. started... 2023-02-11 09:55:14,686 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:14,686 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b9e6247c3c7f22b5fe2c5b9ec537ba6e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:55:14,685 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:14,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:14,686 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 016732cf600178157bb892db15fc6720 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:55:14,686 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. started... 2023-02-11 09:55:14,687 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ffaa59391868e3b78654a134d119206a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:55:15,100 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a 2023-02-11 09:55:15,100 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 2023-02-11 09:55:15,100 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 2023-02-11 09:55:15,505 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e 2023-02-11 09:55:15,505 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/17ef15046b2b4e978fe221839d947bbc 2023-02-11 09:55:15,506 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/5df6dda91d4c4933aedb64c00d719021 2023-02-11 09:55:15,520 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021182ff47f069614e85a300aee5a47f7c05 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021182ff47f069614e85a300aee5a47f7c05 2023-02-11 09:55:15,520 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302111cf64631e96a443ab70f89ca259583f9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302111cf64631e96a443ab70f89ca259583f9 2023-02-11 09:55:15,921 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211f857801098f848c8a6625f5c6bb7a8e7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f857801098f848c8a6625f5c6bb7a8e7 2023-02-11 09:55:15,925 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/af2fdc0294df49fa98b68f182b7b03c5 2023-02-11 09:55:15,929 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e 2023-02-11 09:55:15,929 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/811a9725477b40169a0212590b78e2f5 2023-02-11 09:55:15,933 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 09:55:15,933 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/5df6dda91d4c4933aedb64c00d719021 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021 2023-02-11 09:55:15,934 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/af2fdc0294df49fa98b68f182b7b03c5 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5 2023-02-11 09:55:15,937 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 09:55:15,937 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:55:15,938 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/811a9725477b40169a0212590b78e2f5 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5 2023-02-11 09:55:15,938 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 016732cf600178157bb892db15fc6720 in 1252ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:15,938 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-11 09:55:15,938 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:15,938 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:15,938 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:15,941 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:55:15,942 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ffaa59391868e3b78654a134d119206a in 1255ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:15,942 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:15,942 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:15,943 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:16,326 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/6bb7b6921b15490eab5331c04010820b 2023-02-11 09:55:16,330 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/17ef15046b2b4e978fe221839d947bbc as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc 2023-02-11 09:55:16,333 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 09:55:16,334 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/6bb7b6921b15490eab5331c04010820b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b 2023-02-11 09:55:16,337 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:55:16,337 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b9e6247c3c7f22b5fe2c5b9ec537ba6e in 1651ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:16,338 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:16,338 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:16,338 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:16,338 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:16,338 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,338 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 09:55:16,338 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 09:55:16,339 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,339 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:16,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:16,340 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,340 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:16,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:16,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 09:55:16,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4113c6cb[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:16,341 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 09:55:16,341 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,344 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,344 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 09:55:16,344 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 09:55:16,344 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:16,345 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,345 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 09:55:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:16,347 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,347 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 09:55:16,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:16,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:16,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:16,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:16,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:16,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:16,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 09:55:16,349 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 09:55:16,349 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:16,349 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:16,349 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 09:55:16,350 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:16,351 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,351 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:16,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,351 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:16,351 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:16,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:16,352 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:16,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:16,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:16,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:16,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:16,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:16,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 09:55:16,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:16,354 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:16,354 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:16,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:16,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:16,355 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:16,355 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,355 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:16,355 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,355 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:16,355 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,455 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:16,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:16,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:16,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:16,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:16,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:16,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:16,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 09:55:16,462 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 09:55:16,462 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:16,462 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 09:55:16,462 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 09:55:16,462 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,462 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:16,463 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:16,463 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:16,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:16,464 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:16,464 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:16,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:16,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:16,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:16,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:16,465 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 09:55:16,465 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 09:55:16,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 09:55:16,465 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 09:55:16,465 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:16,465 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 09:55:16,465 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:16,465 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. started... 2023-02-11 09:55:16,466 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b9e6247c3c7f22b5fe2c5b9ec537ba6e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:55:16,472 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:16,472 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. started... 2023-02-11 09:55:16,473 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:16,473 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:16,473 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 016732cf600178157bb892db15fc6720 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:55:16,473 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:16,473 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. started... 2023-02-11 09:55:16,473 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ffaa59391868e3b78654a134d119206a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:55:16,903 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a 2023-02-11 09:55:16,903 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 2023-02-11 09:55:16,903 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 2023-02-11 09:55:17,309 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/69b01c8c34d44d5c9e49b28a8a14bee0 2023-02-11 09:55:17,311 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/b280196a0d3f466fa9c4118592feb68c 2023-02-11 09:55:17,312 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/855dd55ad1e04f99a753f6d113131680 2023-02-11 09:55:17,331 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211cec38277804744bcbeaca4086129b7fd to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cec38277804744bcbeaca4086129b7fd 2023-02-11 09:55:17,730 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021131e5f80a7f1d4221a8eb6bd9dfd19359 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021131e5f80a7f1d4221a8eb6bd9dfd19359 2023-02-11 09:55:17,731 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302115153d59fc0d94d60a154be42b19ef36b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302115153d59fc0d94d60a154be42b19ef36b 2023-02-11 09:55:17,736 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/42e1d84cfa1b4eda94472d8c2aba5cd7 2023-02-11 09:55:17,736 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/f043ca462ab64aec83e2e58c4bd03aab 2023-02-11 09:55:17,740 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/69b01c8c34d44d5c9e49b28a8a14bee0 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0 2023-02-11 09:55:17,740 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/b280196a0d3f466fa9c4118592feb68c as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c 2023-02-11 09:55:17,743 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 09:55:17,744 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 09:55:17,744 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/42e1d84cfa1b4eda94472d8c2aba5cd7 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7 2023-02-11 09:55:17,744 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/f043ca462ab64aec83e2e58c4bd03aab as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab 2023-02-11 09:55:17,747 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:55:17,748 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:55:17,748 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ffaa59391868e3b78654a134d119206a in 1275ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:17,748 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:17,748 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:17,748 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:17,748 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 016732cf600178157bb892db15fc6720 in 1275ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:17,748 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:17,748 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:17,748 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:17,783 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:55:18,137 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/b2756ae715384da8b69d35562fda985f 2023-02-11 09:55:18,141 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/855dd55ad1e04f99a753f6d113131680 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680 2023-02-11 09:55:18,145 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 09:55:18,145 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/b2756ae715384da8b69d35562fda985f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f 2023-02-11 09:55:18,149 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:55:18,150 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b9e6247c3c7f22b5fe2c5b9ec537ba6e in 1684ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:18,150 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:18,150 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 09:55:18,150 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 09:55:18,152 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,152 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:18,152 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,152 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:18,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:18,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:18,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:18,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:18,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:18,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 09:55:18,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31b3624a[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:18,154 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 09:55:18,154 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,155 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 09:55:18,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 09:55:18,155 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:18,155 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,155 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:18,157 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 09:55:18,157 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,157 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,157 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 09:55:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:18,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:18,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:18,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:18,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:18,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:18,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 09:55:18,159 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 09:55:18,159 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:18,159 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:18,159 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 09:55:18,159 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:18,161 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,161 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:18,161 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,161 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:18,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:18,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:18,162 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:18,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:18,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:18,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:18,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:18,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 09:55:18,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:18,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:18,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:18,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:18,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 09:55:18,165 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,166 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,166 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:18,166 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,166 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:18,166 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:18,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:18,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:18,266 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:18,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:18,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:18,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:18,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:18,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:18,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:18,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 09:55:18,272 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 09:55:18,272 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:18,272 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 09:55:18,272 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 09:55:18,272 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,272 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:18,274 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:18,274 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:18,274 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:18,274 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:18,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:18,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:18,275 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 09:55:18,275 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 09:55:18,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 09:55:18,275 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 09:55:18,275 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:18,275 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 09:55:18,275 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:18,275 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. started... 2023-02-11 09:55:18,275 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:18,275 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:18,275 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:18,275 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. started... 2023-02-11 09:55:18,275 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b9e6247c3c7f22b5fe2c5b9ec537ba6e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:55:18,275 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:18,275 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ffaa59391868e3b78654a134d119206a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:55:18,275 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. started... 2023-02-11 09:55:18,276 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 016732cf600178157bb892db15fc6720 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:55:18,689 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 2023-02-11 09:55:18,689 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a 2023-02-11 09:55:18,689 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f 2023-02-11 09:55:19,098 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1 2023-02-11 09:55:19,098 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/4b9695db81924c6cb0fc38c50ac5d131 2023-02-11 09:55:19,098 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/02ae6a603712431ab53184e65611217d 2023-02-11 09:55:19,517 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021129630674081a4578808f8befd1db306a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021129630674081a4578808f8befd1db306a 2023-02-11 09:55:19,517 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021140e8a0bc72ef47edb61ebe04b0ccd1d7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021140e8a0bc72ef47edb61ebe04b0ccd1d7 2023-02-11 09:55:19,517 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302115a63d0f9a69f48bd9a2589319e18788e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115a63d0f9a69f48bd9a2589319e18788e 2023-02-11 09:55:19,522 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/ffd25f32c3534f578fb43145c6f81ad4 2023-02-11 09:55:19,525 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1 2023-02-11 09:55:19,528 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 09:55:19,529 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/ffd25f32c3534f578fb43145c6f81ad4 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4 2023-02-11 09:55:19,531 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:55:19,532 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 016732cf600178157bb892db15fc6720 in 1257ms, sequenceid=13, compaction requested=true 2023-02-11 09:55:19,532 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:19,532 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:19,532 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:19,922 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/84448008f6584a218993cdce28788441 2023-02-11 09:55:19,922 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/745a6d38c3e241659943d927a9902efd 2023-02-11 09:55:19,926 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/02ae6a603712431ab53184e65611217d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d 2023-02-11 09:55:19,927 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/4b9695db81924c6cb0fc38c50ac5d131 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131 2023-02-11 09:55:19,930 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 09:55:19,930 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 09:55:19,931 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/745a6d38c3e241659943d927a9902efd as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd 2023-02-11 09:55:19,931 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/84448008f6584a218993cdce28788441 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441 2023-02-11 09:55:19,934 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:55:19,935 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:55:19,935 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ffaa59391868e3b78654a134d119206a in 1660ms, sequenceid=13, compaction requested=true 2023-02-11 09:55:19,935 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:19,935 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:19,935 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:19,935 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b9e6247c3c7f22b5fe2c5b9ec537ba6e in 1660ms, sequenceid=13, compaction requested=true 2023-02-11 09:55:19,936 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:19,936 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 09:55:19,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 09:55:19,938 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,938 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:19,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:19,938 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,938 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:19,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:19,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:19,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:19,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:19,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 09:55:19,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15969395[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:19,939 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 09:55:19,939 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,940 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,940 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 09:55:19,940 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 09:55:19,940 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:19,941 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,941 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:19,943 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,943 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 09:55:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:19,943 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:19,943 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 09:55:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:19,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:19,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:19,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 09:55:19,945 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 09:55:19,945 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:19,945 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:19,945 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 09:55:19,945 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:19,950 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:19,950 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:19,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:19,950 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:19,950 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:19,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:19,951 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:19,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:19,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:19,953 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:19,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:19,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:19,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 09:55:19,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:19,954 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:19,953 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:19,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:19,954 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,054 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:20,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:20,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:20,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:20,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:20,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:20,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:20,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 09:55:20,060 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 09:55:20,060 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:20,060 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 09:55:20,060 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 09:55:20,061 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,061 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:20,062 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,062 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:20,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:20,062 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,062 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:20,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:20,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 09:55:20,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 09:55:20,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 09:55:20,063 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 09:55:20,063 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:20,063 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 09:55:20,063 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:20,064 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:20,064 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:20,064 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. started... 2023-02-11 09:55:20,064 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. started... 2023-02-11 09:55:20,064 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:20,064 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 016732cf600178157bb892db15fc6720 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:55:20,064 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b9e6247c3c7f22b5fe2c5b9ec537ba6e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:55:20,064 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. started... 2023-02-11 09:55:20,064 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:20,064 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ffaa59391868e3b78654a134d119206a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:55:20,079 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a 2023-02-11 09:55:20,081 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 2023-02-11 09:55:20,089 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/e71d9cf93cf44f5eb70d741d75141c6e 2023-02-11 09:55:20,090 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/a4e4313aa18240059b36f5b58678c6ca 2023-02-11 09:55:20,091 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 2023-02-11 09:55:20,096 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/f9c63979f82a4e5f83b4947103ac9c2f 2023-02-11 09:55:20,102 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021190fe65f86e2348ee95a5351f1ebe4e9c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021190fe65f86e2348ee95a5351f1ebe4e9c 2023-02-11 09:55:20,103 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302112b4567f76f7d441a8ff94e71a11ccd1a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302112b4567f76f7d441a8ff94e71a11ccd1a 2023-02-11 09:55:20,108 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/397df4713f6d4645b1af472026d7d8e0 2023-02-11 09:55:20,109 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211860c411596aa42b399e37c24ceadede7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211860c411596aa42b399e37c24ceadede7 2023-02-11 09:55:20,111 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/a4e4313aa18240059b36f5b58678c6ca as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca 2023-02-11 09:55:20,115 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 09:55:20,115 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/397df4713f6d4645b1af472026d7d8e0 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0 2023-02-11 09:55:20,118 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:55:20,119 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 016732cf600178157bb892db15fc6720 in 55ms, sequenceid=17, compaction requested=true 2023-02-11 09:55:20,119 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:20,119 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:20,119 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:20,508 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/17fa425c1a294e768afc0135eaf7c046 2023-02-11 09:55:20,513 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/e71d9cf93cf44f5eb70d741d75141c6e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e 2023-02-11 09:55:20,514 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/f5586975da1843bea96c0899ba521d29 2023-02-11 09:55:20,517 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 09:55:20,518 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/17fa425c1a294e768afc0135eaf7c046 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046 2023-02-11 09:55:20,519 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/f9c63979f82a4e5f83b4947103ac9c2f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f 2023-02-11 09:55:20,523 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:55:20,524 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 09:55:20,524 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ffaa59391868e3b78654a134d119206a in 460ms, sequenceid=17, compaction requested=true 2023-02-11 09:55:20,524 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:20,524 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:20,524 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:20,524 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/f5586975da1843bea96c0899ba521d29 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29 2023-02-11 09:55:20,530 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:55:20,531 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b9e6247c3c7f22b5fe2c5b9ec537ba6e in 467ms, sequenceid=17, compaction requested=true 2023-02-11 09:55:20,531 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:20,531 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:20,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:20,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:20,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 09:55:20,531 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 09:55:20,534 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,534 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:20,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:20,534 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,534 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:20,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 09:55:20,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fa76639[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:20,536 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 09:55:20,536 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,537 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,537 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 09:55:20,537 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 09:55:20,537 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:20,537 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,537 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 09:55:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:20,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,538 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 09:55:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:20,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:20,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:20,540 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 09:55:20,541 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:20,541 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:20,541 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 09:55:20,541 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:20,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 09:55:20,542 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,542 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,542 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:20,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:20,542 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:20,543 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:20,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,546 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,546 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:20,546 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:20,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 09:55:20,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-11 09:55:20,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:20,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:20,546 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:20,546 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:20,546 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:20,547 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:20,547 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,547 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:20,547 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:20,547 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:20,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:20,547 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:20,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:20,647 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:20,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:20,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 09:55:20,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676109320658 (current time:1676109320658). 2023-02-11 09:55:20,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 09:55:20,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] zookeeper.ReadOnlyZKClient(139): Connect 0x3818ad76 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:20,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a7b700e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:20,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:20,671 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45478, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:20,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3818ad76 to 127.0.0.1:62294 2023-02-11 09:55:20,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:55:20,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 09:55:20,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 09:55:20,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 09:55:20,682 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 09:55:20,683 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676109920683 2023-02-11 09:55:20,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 09:55:20,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676109320648 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-11 09:55:20,684 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 09:55:20,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 09:55:20,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-02-11 09:55:20,686 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 09:55:20,686 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676109920686 2023-02-11 09:55:20,689 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:20,689 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 09:55:20,789 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:20,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:20,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:20,793 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 09:55:20,993 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:20,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:20,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:20,994 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 09:55:21,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676109320648 2023-02-11 09:55:21,093 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676109320648' 2023-02-11 09:55:21,093 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 09:55:21,093 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676109320648' starting 'acquire' 2023-02-11 09:55:21,093 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676109320648', kicking off acquire phase on members. 2023-02-11 09:55:21,094 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,094 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676109320648 2023-02-11 09:55:21,095 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 09:55:21,095 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 09:55:21,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 09:55:21,095 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,095 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:21,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676109320648 2023-02-11 09:55:21,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 09:55:21,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676109320648 2023-02-11 09:55:21,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676109320648 from table testCompactionWithHFileLink type FLUSH 2023-02-11 09:55:21,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676109320648 2023-02-11 09:55:21,098 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676109320648' with timeout 300000ms 2023-02-11 09:55:21,098 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 09:55:21,098 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676109320648' starting 'acquire' stage 2023-02-11 09:55:21,098 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676109320648' locally acquired 2023-02-11 09:55:21,098 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (snaptb-1676109320648) in zk 2023-02-11 09:55:21,100 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,101 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 09:55:21,101 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,101 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676109320648' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:21,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676109320648 2023-02-11 09:55:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:21,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'snaptb-1676109320648' on coordinator 2023-02-11 09:55:21,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40ddde98[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:21,102 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676109320648' starting 'in-barrier' execution. 2023-02-11 09:55:21,102 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,103 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,103 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676109320648' received 'reached' from coordinator. 2023-02-11 09:55:21,103 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,103 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:21,104 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:21,104 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:21,104 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:21,104 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-11 09:55:21,104 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. started... 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. started... 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. started... 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.' region-info for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.' region-info for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,105 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.' region-info for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,110 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 09:55:21,110 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 09:55:21,110 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 09:55:21,114 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca] hfiles 2023-02-11 09:55:21,114 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f] hfiles 2023-02-11 09:55:21,114 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e] hfiles 2023-02-11 09:55:21,114 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,114 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,114 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,117 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046] hfiles 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0] hfiles 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29] hfiles 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,118 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29 for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,294 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:21,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:21,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:21,295 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 09:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. completed. 2023-02-11 09:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. completed. 2023-02-11 09:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. completed. 2023-02-11 09:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:21,527 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:21,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-11 09:55:21,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-11 09:55:21,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-11 09:55:21,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-11 09:55:21,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676109320648' locally completed 2023-02-11 09:55:21,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676109320648' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:21,529 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,529 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676109320648' has notified controller of completion 2023-02-11 09:55:21,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:21,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 09:55:21,529 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:21,529 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676109320648' completed. 2023-02-11 09:55:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676109320648 2023-02-11 09:55:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:21,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676109320648 2023-02-11 09:55:21,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676109320648' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:21,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'snaptb-1676109320648', counting down latch. Waiting for 0 more 2023-02-11 09:55:21,531 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676109320648' execution completed 2023-02-11 09:55:21,532 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:21,532 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:21,532 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676109320648 2023-02-11 09:55:21,532 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676109320648including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 09:55:21,533 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,533 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 09:55:21,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,533 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:21,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 09:55:21,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 09:55:21,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 09:55:21,533 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676109320648 2023-02-11 09:55:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676109320648 2023-02-11 09:55:21,534 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:21,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676109320648 2023-02-11 09:55:21,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 09:55:21,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 09:55:21,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676109320648 because node does not exist (not an error) 2023-02-11 09:55:21,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676109320648 2023-02-11 09:55:21,538 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676109320648 2023-02-11 09:55:21,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676109320648 2023-02-11 09:55:21,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 09:55:21,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 09:55:21,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676109320648 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676109320648/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:21,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676109320648 2023-02-11 09:55:21,538 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676109320648 2023-02-11 09:55:21,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a] mob files 2023-02-11 09:55:21,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 2023-02-11 09:55:21,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a 2023-02-11 09:55:21,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a 2023-02-11 09:55:21,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 2023-02-11 09:55:21,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a 2023-02-11 09:55:21,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021140e8a0bc72ef47edb61ebe04b0ccd1d7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302115153d59fc0d94d60a154be42b19ef36b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211860c411596aa42b399e37c24ceadede7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f857801098f848c8a6625f5c6bb7a8e7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302111cf64631e96a443ab70f89ca259583f9, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021131e5f80a7f1d4221a8eb6bd9dfd19359, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115a63d0f9a69f48bd9a2589319e18788e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021190fe65f86e2348ee95a5351f1ebe4e9c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021129630674081a4578808f8befd1db306a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302112b4567f76f7d441a8ff94e71a11ccd1a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021182ff47f069614e85a300aee5a47f7c05, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cec38277804744bcbeaca4086129b7fd] mob files 2023-02-11 09:55:21,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021140e8a0bc72ef47edb61ebe04b0ccd1d7 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302115153d59fc0d94d60a154be42b19ef36b 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211860c411596aa42b399e37c24ceadede7 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f857801098f848c8a6625f5c6bb7a8e7 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302111cf64631e96a443ab70f89ca259583f9 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021131e5f80a7f1d4221a8eb6bd9dfd19359 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115a63d0f9a69f48bd9a2589319e18788e 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021190fe65f86e2348ee95a5351f1ebe4e9c 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021129630674081a4578808f8befd1db306a 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302112b4567f76f7d441a8ff94e71a11ccd1a 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021182ff47f069614e85a300aee5a47f7c05 2023-02-11 09:55:21,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cec38277804744bcbeaca4086129b7fd 2023-02-11 09:55:21,795 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:21,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:21,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:21,796 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 09:55:21,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676109320648 2023-02-11 09:55:21,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/snaptb-1676109320648 2023-02-11 09:55:22,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/snaptb-1676109320648 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/snaptb-1676109320648 2023-02-11 09:55:22,796 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:22,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:22,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:22,797 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-11 09:55:23,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676109320648 of table testCompactionWithHFileLink completed 2023-02-11 09:55:23,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/snaptb-1676109320648 2023-02-11 09:55:23,205 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/snaptb-1676109320648 2023-02-11 09:55:23,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676109320648 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676109320683Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676109321945 (+1262 ms)Consolidate snapshot: snaptb-1676109320648 at 1676109321945Loading Region manifests for snaptb-1676109320648 at 1676109321946 (+1 ms)Writing data manifest for snaptb-1676109320648 at 1676109321958 (+12 ms)Verifying snapshot: snaptb-1676109320648 at 1676109322365 (+407 ms)Snapshot snaptb-1676109320648 of table testCompactionWithHFileLink completed at 1676109323204 (+839 ms) 2023-02-11 09:55:23,206 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-11 09:55:23,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.5220 sec 2023-02-11 09:55:24,798 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:24,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:24,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 09:55:24,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:24,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:24,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-11 09:55:24,829 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-11 09:55:24,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:24,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-11 09:55:24,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-11 09:55:24,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:24,829 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:24,831 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:24,831 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:24,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:24,831 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:24,831 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:24,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:24,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:24,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:24,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:24,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-11 09:55:24,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-11 09:55:24,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-11 09:55:24,832 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-11 09:55:24,832 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:24,832 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-11 09:55:24,832 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:24,832 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. started... 2023-02-11 09:55:24,832 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:24,832 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b9e6247c3c7f22b5fe2c5b9ec537ba6e 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:55:24,833 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:24,832 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:24,833 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:24,833 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. started... 2023-02-11 09:55:24,833 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. started... 2023-02-11 09:55:24,833 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ffaa59391868e3b78654a134d119206a 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:55:24,833 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 016732cf600178157bb892db15fc6720 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:55:25,254 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/6a1525a2f555451bbd644464242fc6df 2023-02-11 09:55:25,257 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a1525a2f555451bbd644464242fc6df 2023-02-11 09:55:25,653 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/dfb5c01b440a4e1a8789d599a459d896 2023-02-11 09:55:25,653 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/99720f7c91ea439281b677bc9ba1abb7 2023-02-11 09:55:25,656 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfb5c01b440a4e1a8789d599a459d896 2023-02-11 09:55:25,657 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99720f7c91ea439281b677bc9ba1abb7 2023-02-11 09:55:26,075 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/570edeacfbc144728963414651a23ab1 2023-02-11 09:55:26,078 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 570edeacfbc144728963414651a23ab1 2023-02-11 09:55:26,079 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/6a1525a2f555451bbd644464242fc6df as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/6a1525a2f555451bbd644464242fc6df 2023-02-11 09:55:26,082 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a1525a2f555451bbd644464242fc6df 2023-02-11 09:55:26,082 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/6a1525a2f555451bbd644464242fc6df, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 09:55:26,083 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/570edeacfbc144728963414651a23ab1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/570edeacfbc144728963414651a23ab1 2023-02-11 09:55:26,086 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 570edeacfbc144728963414651a23ab1 2023-02-11 09:55:26,086 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/570edeacfbc144728963414651a23ab1, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 09:55:26,086 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/8410995b3937423aad10964bb76d6f19 2023-02-11 09:55:26,086 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b9e6247c3c7f22b5fe2c5b9ec537ba6e in 1254ms, sequenceid=24, compaction requested=true 2023-02-11 09:55:26,087 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:26,087 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:26,087 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:26,089 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8410995b3937423aad10964bb76d6f19 2023-02-11 09:55:26,089 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/99720f7c91ea439281b677bc9ba1abb7 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/99720f7c91ea439281b677bc9ba1abb7 2023-02-11 09:55:26,092 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99720f7c91ea439281b677bc9ba1abb7 2023-02-11 09:55:26,092 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/99720f7c91ea439281b677bc9ba1abb7, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 09:55:26,093 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/8410995b3937423aad10964bb76d6f19 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/8410995b3937423aad10964bb76d6f19 2023-02-11 09:55:26,096 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8410995b3937423aad10964bb76d6f19 2023-02-11 09:55:26,096 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/8410995b3937423aad10964bb76d6f19, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 09:55:26,096 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ffaa59391868e3b78654a134d119206a in 1263ms, sequenceid=24, compaction requested=true 2023-02-11 09:55:26,096 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:26,096 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:26,096 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:26,479 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/48d732439e4d481ca1e913b7a4d195eb 2023-02-11 09:55:26,482 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48d732439e4d481ca1e913b7a4d195eb 2023-02-11 09:55:26,483 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/dfb5c01b440a4e1a8789d599a459d896 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/dfb5c01b440a4e1a8789d599a459d896 2023-02-11 09:55:26,486 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfb5c01b440a4e1a8789d599a459d896 2023-02-11 09:55:26,486 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/dfb5c01b440a4e1a8789d599a459d896, entries=3, sequenceid=24, filesize=5.0 K 2023-02-11 09:55:26,487 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/48d732439e4d481ca1e913b7a4d195eb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/48d732439e4d481ca1e913b7a4d195eb 2023-02-11 09:55:26,490 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48d732439e4d481ca1e913b7a4d195eb 2023-02-11 09:55:26,490 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/48d732439e4d481ca1e913b7a4d195eb, entries=1, sequenceid=24, filesize=5.0 K 2023-02-11 09:55:26,491 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 016732cf600178157bb892db15fc6720 in 1658ms, sequenceid=24, compaction requested=true 2023-02-11 09:55:26,491 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:26,491 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:26,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:26,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:26,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-11 09:55:26,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-11 09:55:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,493 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:26,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-11 09:55:26,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ad645fb[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:26,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-11 09:55:26,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,496 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-11 09:55:26,496 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,496 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-11 09:55:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:26,503 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-11 09:55:26,503 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,503 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:26,503 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-11 09:55:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:26,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-11 09:55:26,506 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-11 09:55:26,506 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:26,506 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:26,506 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-11 09:55:26,506 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:26,507 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:26,507 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:26,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:26,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:26,507 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:26,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:26,508 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:26,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,509 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:26,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-11 09:55:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:26,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:26,511 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:26,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-11 09:55:26,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:26,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:26,511 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:26,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:26,612 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:26,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:26,613 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:26,613 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 is initiating major compaction (all files) 2023-02-11 09:55:26,613 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:26,613 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:26,614 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 in testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:26,614 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/6a1525a2f555451bbd644464242fc6df] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp, totalSize=26.7 K 2023-02-11 09:55:26,614 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 17ef15046b2b4e978fe221839d947bbc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:26,615 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 855dd55ad1e04f99a753f6d113131680, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:26,615 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 4b9695db81924c6cb0fc38c50ac5d131, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:26,615 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting f9c63979f82a4e5f83b4947103ac9c2f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:26,616 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 6a1525a2f555451bbd644464242fc6df, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 09:55:26,630 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): b9e6247c3c7f22b5fe2c5b9ec537ba6e#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:27,039 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021109adc2595cd74dbd8aa8fa363b5b3f41_del 2023-02-11 09:55:27,039 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021109adc2595cd74dbd8aa8fa363b5b3f41_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021109adc2595cd74dbd8aa8fa363b5b3f41_del 2023-02-11 09:55:27,051 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b02cde5a2e584c658bd8ce61e740c4c6 2023-02-11 09:55:27,052 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/b02cde5a2e584c658bd8ce61e740c4c6 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/b02cde5a2e584c658bd8ce61e740c4c6 2023-02-11 09:55:27,056 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b02cde5a2e584c658bd8ce61e740c4c6 2023-02-11 09:55:27,057 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 of b9e6247c3c7f22b5fe2c5b9ec537ba6e into b02cde5a2e584c658bd8ce61e740c4c6(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:27,057 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:27,057 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:27,057 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 is initiating major compaction (all files) 2023-02-11 09:55:27,057 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:27,057 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:27,058 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 in testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:27,058 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/570edeacfbc144728963414651a23ab1] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp, totalSize=25.4 K 2023-02-11 09:55:27,058 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 6bb7b6921b15490eab5331c04010820b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:27,059 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting b2756ae715384da8b69d35562fda985f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:27,059 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 84448008f6584a218993cdce28788441, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:27,059 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting f5586975da1843bea96c0899ba521d29, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:27,060 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 570edeacfbc144728963414651a23ab1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 09:55:27,070 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): b9e6247c3c7f22b5fe2c5b9ec537ba6e#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:27,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/6a1525a2f555451bbd644464242fc6df] to archive 2023-02-11 09:55:27,145 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:27,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/17ef15046b2b4e978fe221839d947bbc 2023-02-11 09:55:27,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/855dd55ad1e04f99a753f6d113131680 2023-02-11 09:55:27,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/4b9695db81924c6cb0fc38c50ac5d131 2023-02-11 09:55:27,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/f9c63979f82a4e5f83b4947103ac9c2f 2023-02-11 09:55:27,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/6a1525a2f555451bbd644464242fc6df to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/6a1525a2f555451bbd644464242fc6df 2023-02-11 09:55:27,480 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302112a463b965a324767adc8579a71b87d63_del 2023-02-11 09:55:27,480 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302112a463b965a324767adc8579a71b87d63_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112a463b965a324767adc8579a71b87d63_del 2023-02-11 09:55:28,293 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae02be8ea7c74c2ead8a1ea38726e287 2023-02-11 09:55:28,293 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/ae02be8ea7c74c2ead8a1ea38726e287 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/ae02be8ea7c74c2ead8a1ea38726e287 2023-02-11 09:55:28,297 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae02be8ea7c74c2ead8a1ea38726e287 2023-02-11 09:55:28,298 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 of b9e6247c3c7f22b5fe2c5b9ec537ba6e into ae02be8ea7c74c2ead8a1ea38726e287(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:28,298 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:28,298 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:28,298 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 016732cf600178157bb892db15fc6720/family1 is initiating major compaction (all files) 2023-02-11 09:55:28,298 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:28,298 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:28,299 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 016732cf600178157bb892db15fc6720/family1 in testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:28,299 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/dfb5c01b440a4e1a8789d599a459d896] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp, totalSize=26.7 K 2023-02-11 09:55:28,299 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting b8d8cb7259a54ee5ad022c5ea8ac1f6e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314675 2023-02-11 09:55:28,300 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting b280196a0d3f466fa9c4118592feb68c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:28,300 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting ecbfa7af5b0e4cf3bd19e913bd3be1e1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:28,300 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting a4e4313aa18240059b36f5b58678c6ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320055 2023-02-11 09:55:28,301 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting dfb5c01b440a4e1a8789d599a459d896, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 09:55:28,311 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 016732cf600178157bb892db15fc6720#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:28,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/570edeacfbc144728963414651a23ab1] to archive 2023-02-11 09:55:28,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:28,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/6bb7b6921b15490eab5331c04010820b 2023-02-11 09:55:28,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/b2756ae715384da8b69d35562fda985f 2023-02-11 09:55:28,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/84448008f6584a218993cdce28788441 2023-02-11 09:55:28,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/f5586975da1843bea96c0899ba521d29 2023-02-11 09:55:28,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/570edeacfbc144728963414651a23ab1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/570edeacfbc144728963414651a23ab1 2023-02-11 09:55:28,719 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021103a8f92d86054da5bbcbf38c2b54cf79_del 2023-02-11 09:55:28,719 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021103a8f92d86054da5bbcbf38c2b54cf79_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021103a8f92d86054da5bbcbf38c2b54cf79_del 2023-02-11 09:55:29,533 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9e0bee47784227969c2003f4c6d97f 2023-02-11 09:55:29,533 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/de9e0bee47784227969c2003f4c6d97f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/de9e0bee47784227969c2003f4c6d97f 2023-02-11 09:55:29,537 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9e0bee47784227969c2003f4c6d97f 2023-02-11 09:55:29,538 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 016732cf600178157bb892db15fc6720/family1 of 016732cf600178157bb892db15fc6720 into de9e0bee47784227969c2003f4c6d97f(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:29,538 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:29,538 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:29,538 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 016732cf600178157bb892db15fc6720/family2 is initiating major compaction (all files) 2023-02-11 09:55:29,538 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:29,538 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:29,539 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 016732cf600178157bb892db15fc6720/family2 in testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:29,539 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/48d732439e4d481ca1e913b7a4d195eb] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp, totalSize=25.4 K 2023-02-11 09:55:29,539 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting af2fdc0294df49fa98b68f182b7b03c5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314675 2023-02-11 09:55:29,540 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting f043ca462ab64aec83e2e58c4bd03aab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:29,540 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting ffd25f32c3534f578fb43145c6f81ad4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:29,540 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 397df4713f6d4645b1af472026d7d8e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320055 2023-02-11 09:55:29,541 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 48d732439e4d481ca1e913b7a4d195eb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 09:55:29,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/dfb5c01b440a4e1a8789d599a459d896] to archive 2023-02-11 09:55:29,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:29,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b8d8cb7259a54ee5ad022c5ea8ac1f6e 2023-02-11 09:55:29,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/b280196a0d3f466fa9c4118592feb68c 2023-02-11 09:55:29,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/ecbfa7af5b0e4cf3bd19e913bd3be1e1 2023-02-11 09:55:29,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4e4313aa18240059b36f5b58678c6ca 2023-02-11 09:55:29,552 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 016732cf600178157bb892db15fc6720#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:29,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/dfb5c01b440a4e1a8789d599a459d896 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/dfb5c01b440a4e1a8789d599a459d896 2023-02-11 09:55:29,959 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211beb88164846d4c2681dc8321d9ebe7e6_del 2023-02-11 09:55:29,959 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211beb88164846d4c2681dc8321d9ebe7e6_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211beb88164846d4c2681dc8321d9ebe7e6_del 2023-02-11 09:55:30,772 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03e2393acebb4d0ca5e88defa1c5ed27 2023-02-11 09:55:30,773 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/03e2393acebb4d0ca5e88defa1c5ed27 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/03e2393acebb4d0ca5e88defa1c5ed27 2023-02-11 09:55:30,776 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03e2393acebb4d0ca5e88defa1c5ed27 2023-02-11 09:55:30,777 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 016732cf600178157bb892db15fc6720/family2 of 016732cf600178157bb892db15fc6720 into 03e2393acebb4d0ca5e88defa1c5ed27(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:30,777 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:30,777 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:30,777 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): ffaa59391868e3b78654a134d119206a/family1 is initiating major compaction (all files) 2023-02-11 09:55:30,777 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:30,777 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:30,778 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of ffaa59391868e3b78654a134d119206a/family1 in testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:30,778 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/99720f7c91ea439281b677bc9ba1abb7] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp, totalSize=26.7 K 2023-02-11 09:55:30,778 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 5df6dda91d4c4933aedb64c00d719021, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:30,779 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 69b01c8c34d44d5c9e49b28a8a14bee0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:30,779 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 02ae6a603712431ab53184e65611217d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:30,779 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting e71d9cf93cf44f5eb70d741d75141c6e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:30,780 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 99720f7c91ea439281b677bc9ba1abb7, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 09:55:30,789 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): ffaa59391868e3b78654a134d119206a#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:30,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/48d732439e4d481ca1e913b7a4d195eb] to archive 2023-02-11 09:55:30,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:30,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/af2fdc0294df49fa98b68f182b7b03c5 2023-02-11 09:55:30,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/f043ca462ab64aec83e2e58c4bd03aab 2023-02-11 09:55:30,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/ffd25f32c3534f578fb43145c6f81ad4 2023-02-11 09:55:30,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/397df4713f6d4645b1af472026d7d8e0 2023-02-11 09:55:30,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/48d732439e4d481ca1e913b7a4d195eb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/48d732439e4d481ca1e913b7a4d195eb 2023-02-11 09:55:31,198 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211bd08eaf6ceda48b3a0652c78b1a1cdd8_del 2023-02-11 09:55:31,198 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211bd08eaf6ceda48b3a0652c78b1a1cdd8_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211bd08eaf6ceda48b3a0652c78b1a1cdd8_del 2023-02-11 09:55:32,011 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bfa6a9325bd4d0e865f5393dfcd8bd9 2023-02-11 09:55:32,012 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/3bfa6a9325bd4d0e865f5393dfcd8bd9 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/3bfa6a9325bd4d0e865f5393dfcd8bd9 2023-02-11 09:55:32,015 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bfa6a9325bd4d0e865f5393dfcd8bd9 2023-02-11 09:55:32,016 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ffaa59391868e3b78654a134d119206a/family1 of ffaa59391868e3b78654a134d119206a into 3bfa6a9325bd4d0e865f5393dfcd8bd9(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:32,017 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:32,017 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:32,017 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): ffaa59391868e3b78654a134d119206a/family2 is initiating major compaction (all files) 2023-02-11 09:55:32,017 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:32,017 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:32,018 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of ffaa59391868e3b78654a134d119206a/family2 in testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:32,018 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/8410995b3937423aad10964bb76d6f19] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp, totalSize=25.4 K 2023-02-11 09:55:32,018 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 811a9725477b40169a0212590b78e2f5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:32,018 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 42e1d84cfa1b4eda94472d8c2aba5cd7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:32,018 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 745a6d38c3e241659943d927a9902efd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:32,019 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 17fa425c1a294e768afc0135eaf7c046, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:32,019 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 8410995b3937423aad10964bb76d6f19, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-11 09:55:32,029 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): ffaa59391868e3b78654a134d119206a#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:32,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/99720f7c91ea439281b677bc9ba1abb7] to archive 2023-02-11 09:55:32,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:32,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/5df6dda91d4c4933aedb64c00d719021 2023-02-11 09:55:32,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/69b01c8c34d44d5c9e49b28a8a14bee0 2023-02-11 09:55:32,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/02ae6a603712431ab53184e65611217d 2023-02-11 09:55:32,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/e71d9cf93cf44f5eb70d741d75141c6e 2023-02-11 09:55:32,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/99720f7c91ea439281b677bc9ba1abb7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/99720f7c91ea439281b677bc9ba1abb7 2023-02-11 09:55:32,436 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302119cc3389a0ad94b5089352c9c95809bfa_del 2023-02-11 09:55:32,436 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302119cc3389a0ad94b5089352c9c95809bfa_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302119cc3389a0ad94b5089352c9c95809bfa_del 2023-02-11 09:55:33,249 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 459a0c495bec4a34998828e8affb6aae 2023-02-11 09:55:33,250 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/459a0c495bec4a34998828e8affb6aae as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/459a0c495bec4a34998828e8affb6aae 2023-02-11 09:55:33,253 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 459a0c495bec4a34998828e8affb6aae 2023-02-11 09:55:33,254 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ffaa59391868e3b78654a134d119206a/family2 of ffaa59391868e3b78654a134d119206a into 459a0c495bec4a34998828e8affb6aae(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:33,254 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:33,259 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:33,262 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:33,267 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:33,268 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:33,285 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 09:55:33,318 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-11 09:55:33,321 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021103a8f92d86054da5bbcbf38c2b54cf79_del 2023-02-11 09:55:33,324 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021109adc2595cd74dbd8aa8fa363b5b3f41_del 2023-02-11 09:55:33,327 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211bd08eaf6ceda48b3a0652c78b1a1cdd8_del 2023-02-11 09:55:33,327 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:33,328 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(139): Connect 0x049d301c to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:33,334 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739501ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:33,334 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:33,334 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:33,334 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:33,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/8410995b3937423aad10964bb76d6f19] to archive 2023-02-11 09:55:33,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:33,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/811a9725477b40169a0212590b78e2f5 2023-02-11 09:55:33,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/42e1d84cfa1b4eda94472d8c2aba5cd7 2023-02-11 09:55:33,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/745a6d38c3e241659943d927a9902efd 2023-02-11 09:55:33,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/17fa425c1a294e768afc0135eaf7c046 2023-02-11 09:55:33,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/8410995b3937423aad10964bb76d6f19 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/8410995b3937423aad10964bb76d6f19 2023-02-11 09:55:34,184 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302111b3d9c6cb9914c7d9b083b357a2d2877 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302111b3d9c6cb9914c7d9b083b357a2d2877 2023-02-11 09:55:34,185 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:34,196 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211efbf126cb0f74a73b8b22d3fc011667f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211efbf126cb0f74a73b8b22d3fc011667f 2023-02-11 09:55:34,196 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021145935f6e46974db3ae5b236555dee33a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021145935f6e46974db3ae5b236555dee33a 2023-02-11 09:55:34,197 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:34,198 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:34,199 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:34,202 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34490, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:34,208 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:55:34,210 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:55:34,224 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/8e029181b1ce4d2195bee0d5742edf0b first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-11 09:55:34,224 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/8e029181b1ce4d2195bee0d5742edf0b}] 2023-02-11 09:55:34,230 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/8e029181b1ce4d2195bee0d5742edf0b for inclusion in 016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:34,231 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac2c75c7ab47452a85af2a84299ff06d first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-11 09:55:34,233 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac2c75c7ab47452a85af2a84299ff06d}] 2023-02-11 09:55:34,235 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-11 09:55:34,235 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38}] 2023-02-11 09:55:34,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-11 09:55:34,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 09:55:34,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac2c75c7ab47452a85af2a84299ff06d for inclusion in ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:34,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:34,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/8e029181b1ce4d2195bee0d5742edf0b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__39r90cgg6joiqnmos5nnvl45a1gi12o165p23rm1muugcpcts56807uuruef7igd/family1/8e029181b1ce4d2195bee0d5742edf0b 2023-02-11 09:55:34,237 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 for inclusion in b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:34,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-11 09:55:34,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 09:55:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__39r90cgg6joiqnmos5nnvl45a1gi12o165p23rm1muugcpcts56807uuruef7igd/family1/8e029181b1ce4d2195bee0d5742edf0b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_ 2023-02-11 09:55:34,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/ac2c75c7ab47452a85af2a84299ff06d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__8bu1vsnkgkctvvufd99luad3e20k21t49q3ce47f04cd1i4rqejl5g9hvmkp8pha/family1/ac2c75c7ab47452a85af2a84299ff06d 2023-02-11 09:55:34,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-11 09:55:34,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 09:55:34,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__39r90cgg6joiqnmos5nnvl45a1gi12o165p23rm1muugcpcts56807uuruef7igd/family1/8e029181b1ce4d2195bee0d5742edf0b into 016732cf600178157bb892db15fc6720/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_ - updating store file list. 2023-02-11 09:55:34,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:34,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ghee78de4gnvgeur0801g6098ebv8j85j7712ho980n4j0mmi3aa0hfbeoonue8h/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 2023-02-11 09:55:34,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__8bu1vsnkgkctvvufd99luad3e20k21t49q3ce47f04cd1i4rqejl5g9hvmkp8pha/family1/ac2c75c7ab47452a85af2a84299ff06d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_ 2023-02-11 09:55:34,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ghee78de4gnvgeur0801g6098ebv8j85j7712ho980n4j0mmi3aa0hfbeoonue8h/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_ 2023-02-11 09:55:34,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__8bu1vsnkgkctvvufd99luad3e20k21t49q3ce47f04cd1i4rqejl5g9hvmkp8pha/family1/ac2c75c7ab47452a85af2a84299ff06d into ffaa59391868e3b78654a134d119206a/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_ - updating store file list. 2023-02-11 09:55:34,244 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ghee78de4gnvgeur0801g6098ebv8j85j7712ho980n4j0mmi3aa0hfbeoonue8h/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 into b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_ - updating store file list. 2023-02-11 09:55:34,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_ into 016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:34,246 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__39r90cgg6joiqnmos5nnvl45a1gi12o165p23rm1muugcpcts56807uuruef7igd/family1/8e029181b1ce4d2195bee0d5742edf0b into 016732cf600178157bb892db15fc6720/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_) 2023-02-11 09:55:34,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__39r90cgg6joiqnmos5nnvl45a1gi12o165p23rm1muugcpcts56807uuruef7igd/family1/8e029181b1ce4d2195bee0d5742edf0b 2023-02-11 09:55:34,248 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_ into b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:34,248 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ghee78de4gnvgeur0801g6098ebv8j85j7712ho980n4j0mmi3aa0hfbeoonue8h/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 into b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_) 2023-02-11 09:55:34,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ghee78de4gnvgeur0801g6098ebv8j85j7712ho980n4j0mmi3aa0hfbeoonue8h/family1/5fa4b926b0ea4cd78d5b4f4d7be25a38 2023-02-11 09:55:34,249 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:34,250 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:34,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_ into ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:34,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__8bu1vsnkgkctvvufd99luad3e20k21t49q3ce47f04cd1i4rqejl5g9hvmkp8pha/family1/ac2c75c7ab47452a85af2a84299ff06d into ffaa59391868e3b78654a134d119206a/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_) 2023-02-11 09:55:34,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__8bu1vsnkgkctvvufd99luad3e20k21t49q3ce47f04cd1i4rqejl5g9hvmkp8pha/family1/ac2c75c7ab47452a85af2a84299ff06d 2023-02-11 09:55:34,251 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:34,252 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 2023-02-11 09:55:34,252 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:34,252 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:34,253 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 2023-02-11 09:55:34,253 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:34,253 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 2023-02-11 09:55:34,254 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 2023-02-11 09:55:34,254 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a 2023-02-11 09:55:34,254 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a 2023-02-11 09:55:34,255 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a 2023-02-11 09:55:34,255 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 09:55:34,255 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 09:55:34,255 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f 2023-02-11 09:55:34,255 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a 2023-02-11 09:55:34,256 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:34,256 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 2023-02-11 09:55:34,257 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 2023-02-11 09:55:34,257 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 09:55:34,257 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 09:55:34,257 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:34,257 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 2023-02-11 09:55:34,257 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 09:55:34,258 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 09:55:34,258 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:34,258 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:34,258 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:34,258 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021103a8f92d86054da5bbcbf38c2b54cf79_del] 2023-02-11 09:55:34,258 DEBUG [Listener at localhost/44465] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:34,259 DEBUG [Listener at localhost/44465] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021103a8f92d86054da5bbcbf38c2b54cf79_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021103a8f92d86054da5bbcbf38c2b54cf79_del 2023-02-11 09:55:34,260 INFO [Listener at localhost/44465] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 09:55:34,260 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021109adc2595cd74dbd8aa8fa363b5b3f41_del] 2023-02-11 09:55:34,260 DEBUG [Listener at localhost/44465] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:34,261 DEBUG [Listener at localhost/44465] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021109adc2595cd74dbd8aa8fa363b5b3f41_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021109adc2595cd74dbd8aa8fa363b5b3f41_del 2023-02-11 09:55:34,261 INFO [Listener at localhost/44465] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 09:55:34,261 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211bd08eaf6ceda48b3a0652c78b1a1cdd8_del] 2023-02-11 09:55:34,262 DEBUG [Listener at localhost/44465] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:34,263 DEBUG [Listener at localhost/44465] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211bd08eaf6ceda48b3a0652c78b1a1cdd8_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211bd08eaf6ceda48b3a0652c78b1a1cdd8_del 2023-02-11 09:55:34,263 INFO [Listener at localhost/44465] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-11 09:55:34,265 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:34,268 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:34,270 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:34,271 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:34,275 INFO [Listener at localhost/44465] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-11 09:55:34,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-11 09:55:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-11 09:55:34,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 09:55:34,278 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109334278"}]},"ts":"1676109334278"} 2023-02-11 09:55:34,279 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-11 09:55:34,281 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-11 09:55:34,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, UNASSIGN}] 2023-02-11 09:55:34,282 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, UNASSIGN 2023-02-11 09:55:34,282 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, UNASSIGN 2023-02-11 09:55:34,282 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, UNASSIGN 2023-02-11 09:55:34,283 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ffaa59391868e3b78654a134d119206a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:34,283 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b9e6247c3c7f22b5fe2c5b9ec537ba6e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:34,283 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109334283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109334283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109334283"}]},"ts":"1676109334283"} 2023-02-11 09:55:34,283 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=016732cf600178157bb892db15fc6720, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:34,283 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109334283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109334283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109334283"}]},"ts":"1676109334283"} 2023-02-11 09:55:34,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109334283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109334283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109334283"}]},"ts":"1676109334283"} 2023-02-11 09:55:34,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure ffaa59391868e3b78654a134d119206a, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:34,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure b9e6247c3c7f22b5fe2c5b9ec537ba6e, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:34,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 016732cf600178157bb892db15fc6720, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:34,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 09:55:34,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:34,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ffaa59391868e3b78654a134d119206a, disabling compactions & flushes 2023-02-11 09:55:34,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:34,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:34,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. after waiting 0 ms 2023-02-11 09:55:34,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:34,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 09:55:34,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:34,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ffaa59391868e3b78654a134d119206a: Waiting for close lock at 1676109334436Running coprocessor pre-close hooks at 1676109334436Disabling compacts and flushes for region at 1676109334436Disabling writes for close at 1676109334436Writing region close event to WAL at 1676109334437 (+1 ms)Running coprocessor post-close hooks at 1676109334440 (+3 ms)Closed at 1676109334441 (+1 ms) 2023-02-11 09:55:34,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:34,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b9e6247c3c7f22b5fe2c5b9ec537ba6e, disabling compactions & flushes 2023-02-11 09:55:34,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:34,443 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ffaa59391868e3b78654a134d119206a, regionState=CLOSED 2023-02-11 09:55:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. after waiting 0 ms 2023-02-11 09:55:34,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:34,443 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109334443"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109334443"}]},"ts":"1676109334443"} 2023-02-11 09:55:34,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-02-11 09:55:34,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure ffaa59391868e3b78654a134d119206a, server=jenkins-hbase4.apache.org,43463,1676109215499 in 160 msec 2023-02-11 09:55:34,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, UNASSIGN in 164 msec 2023-02-11 09:55:34,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 09:55:34,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:34,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: Waiting for close lock at 1676109334443Running coprocessor pre-close hooks at 1676109334443Disabling compacts and flushes for region at 1676109334443Disabling writes for close at 1676109334443Writing region close event to WAL at 1676109334444 (+1 ms)Running coprocessor post-close hooks at 1676109334447 (+3 ms)Closed at 1676109334447 2023-02-11 09:55:34,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:34,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 016732cf600178157bb892db15fc6720 2023-02-11 09:55:34,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 016732cf600178157bb892db15fc6720, disabling compactions & flushes 2023-02-11 09:55:34,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:34,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:34,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. after waiting 0 ms 2023-02-11 09:55:34,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:34,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b9e6247c3c7f22b5fe2c5b9ec537ba6e, regionState=CLOSED 2023-02-11 09:55:34,449 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109334449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109334449"}]},"ts":"1676109334449"} 2023-02-11 09:55:34,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-02-11 09:55:34,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure b9e6247c3c7f22b5fe2c5b9ec537ba6e, server=jenkins-hbase4.apache.org,43463,1676109215499 in 166 msec 2023-02-11 09:55:34,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, UNASSIGN in 170 msec 2023-02-11 09:55:34,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-11 09:55:34,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:34,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 016732cf600178157bb892db15fc6720: Waiting for close lock at 1676109334449Running coprocessor pre-close hooks at 1676109334449Disabling compacts and flushes for region at 1676109334449Disabling writes for close at 1676109334449Writing region close event to WAL at 1676109334450 (+1 ms)Running coprocessor post-close hooks at 1676109334453 (+3 ms)Closed at 1676109334453 2023-02-11 09:55:34,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 016732cf600178157bb892db15fc6720 2023-02-11 09:55:34,454 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=016732cf600178157bb892db15fc6720, regionState=CLOSED 2023-02-11 09:55:34,454 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109334454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109334454"}]},"ts":"1676109334454"} 2023-02-11 09:55:34,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-02-11 09:55:34,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 016732cf600178157bb892db15fc6720, server=jenkins-hbase4.apache.org,43463,1676109215499 in 170 msec 2023-02-11 09:55:34,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-02-11 09:55:34,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, UNASSIGN in 175 msec 2023-02-11 09:55:34,458 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109334458"}]},"ts":"1676109334458"} 2023-02-11 09:55:34,459 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-11 09:55:34,460 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-11 09:55:34,462 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 186 msec 2023-02-11 09:55:34,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-11 09:55:34,579 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-11 09:55:34,729 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-11 09:55:34,730 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:55:34,730 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x049d301c to 127.0.0.1:62294 2023-02-11 09:55:34,730 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:55:34,737 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:55:34,738 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ecfd59d to 127.0.0.1:62294 2023-02-11 09:55:34,738 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:55:34,738 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f38fd7a to 127.0.0.1:62294 2023-02-11 09:55:34,738 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:55:34,738 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:55:34,738 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f7ff67c to 127.0.0.1:62294 2023-02-11 09:55:34,738 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:55:34,738 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:55:34,738 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x284a011d to 127.0.0.1:62294 2023-02-11 09:55:34,738 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:55:34,745 INFO [Listener at localhost/44465] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:34,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 09:55:34,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676109334746 (current time:1676109334746). 2023-02-11 09:55:34,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 09:55:34,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] zookeeper.ReadOnlyZKClient(139): Connect 0x4d0d9774 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:34,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6341d605, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:34,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:34,753 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34502, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d0d9774 to 127.0.0.1:62294 2023-02-11 09:55:34,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:55:34,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 09:55:34,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 09:55:34,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 09:55:34,757 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 09:55:34,758 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676109934758 2023-02-11 09:55:34,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676109320648-1676109334745 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-11 09:55:34,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 09:55:34,758 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:34,758 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 09:55:34,858 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:34,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:34,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:34,859 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 09:55:35,059 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:35,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:35,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:35,060 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 09:55:35,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 09:55:35,166 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/b02cde5a2e584c658bd8ce61e740c4c6, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_] hfiles 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/3bfa6a9325bd4d0e865f5393dfcd8bd9, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_] hfiles 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/de9e0bee47784227969c2003f4c6d97f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_] hfiles 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/b02cde5a2e584c658bd8ce61e740c4c6 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/de9e0bee47784227969c2003f4c6d97f 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_ 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_ 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/3bfa6a9325bd4d0e865f5393dfcd8bd9 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021145935f6e46974db3ae5b236555dee33a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211efbf126cb0f74a73b8b22d3fc011667f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302111b3d9c6cb9914c7d9b083b357a2d2877] hfiles 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_ 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021145935f6e46974db3ae5b236555dee33a 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211efbf126cb0f74a73b8b22d3fc011667f 2023-02-11 09:55:35,169 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302111b3d9c6cb9914c7d9b083b357a2d2877 2023-02-11 09:55:35,170 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/ae02be8ea7c74c2ead8a1ea38726e287] hfiles 2023-02-11 09:55:35,170 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/ae02be8ea7c74c2ead8a1ea38726e287 2023-02-11 09:55:35,170 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/03e2393acebb4d0ca5e88defa1c5ed27] hfiles 2023-02-11 09:55:35,170 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/459a0c495bec4a34998828e8affb6aae] hfiles 2023-02-11 09:55:35,170 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/03e2393acebb4d0ca5e88defa1c5ed27 2023-02-11 09:55:35,170 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/459a0c495bec4a34998828e8affb6aae 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112a463b965a324767adc8579a71b87d63_del, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021140e8a0bc72ef47edb61ebe04b0ccd1d7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302115153d59fc0d94d60a154be42b19ef36b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211860c411596aa42b399e37c24ceadede7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f857801098f848c8a6625f5c6bb7a8e7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302111cf64631e96a443ab70f89ca259583f9, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021131e5f80a7f1d4221a8eb6bd9dfd19359, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115a63d0f9a69f48bd9a2589319e18788e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021190fe65f86e2348ee95a5351f1ebe4e9c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302119cc3389a0ad94b5089352c9c95809bfa_del, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021129630674081a4578808f8befd1db306a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302112b4567f76f7d441a8ff94e71a11ccd1a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021182ff47f069614e85a300aee5a47f7c05, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211beb88164846d4c2681dc8321d9ebe7e6_del, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cec38277804744bcbeaca4086129b7fd] hfiles 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112a463b965a324767adc8579a71b87d63_del 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021140e8a0bc72ef47edb61ebe04b0ccd1d7 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302115153d59fc0d94d60a154be42b19ef36b 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211860c411596aa42b399e37c24ceadede7 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230211f857801098f848c8a6625f5c6bb7a8e7 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302111cf64631e96a443ab70f89ca259583f9 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021131e5f80a7f1d4221a8eb6bd9dfd19359 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302115a63d0f9a69f48bd9a2589319e18788e 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021190fe65f86e2348ee95a5351f1ebe4e9c 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302119cc3389a0ad94b5089352c9c95809bfa_del 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021129630674081a4578808f8befd1db306a 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302112b4567f76f7d441a8ff94e71a11ccd1a 2023-02-11 09:55:35,175 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021182ff47f069614e85a300aee5a47f7c05 2023-02-11 09:55:35,176 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211beb88164846d4c2681dc8321d9ebe7e6_del 2023-02-11 09:55:35,176 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211cec38277804744bcbeaca4086129b7fd 2023-02-11 09:55:35,360 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:35,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:35,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:35,361 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 09:55:35,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-11 09:55:35,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:35,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:35,861 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:35,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:35,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-11 09:55:35,862 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 09:55:36,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676109320648-1676109334745 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:36,424 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676109320648-1676109334745 of table testCompactionWithHFileLink completed 2023-02-11 09:55:36,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:36,424 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:36,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676109320648-1676109334745 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676109334758Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676109335164 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676109320648-1676109334745 at 1676109335580 (+416 ms)Loading Region manifests for hbase-failsafe-snaptb-1676109320648-1676109334745 at 1676109335580Writing data manifest for hbase-failsafe-snaptb-1676109320648-1676109334745 at 1676109335583 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1676109320648-1676109334745 at 1676109335988 (+405 ms)Snapshot hbase-failsafe-snaptb-1676109320648-1676109334745 of table testCompactionWithHFileLink completed at 1676109336424 (+436 ms) 2023-02-11 09:55:36,425 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-11 09:55:36,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6700 sec 2023-02-11 09:55:36,863 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 09:55:36,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-11 09:55:36,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676109320648-1676109334745 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 09:55:36,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676109320648" table: "testCompactionWithHFileLink" creation_time: 1676109320658 type: FLUSH version: 2 ttl: 0 ) 2023-02-11 09:55:36,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676109320648 as table=testCompactionWithHFileLink 2023-02-11 09:55:36,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 09:55:36,918 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-11 09:55:36,918 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-11 09:55:36,918 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-11 09:55:36,919 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-11 09:55:36,923 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676109320648" table: "testCompactionWithHFileLink" creation_time: 1676109320658 type: FLUSH version: 2 ttl: 0 2023-02-11 09:55:36,923 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink 2023-02-11 09:55:36,928 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-11 09:55:36,931 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021145935f6e46974db3ae5b236555dee33a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021145935f6e46974db3ae5b236555dee33a 2023-02-11 09:55:36,932 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211efbf126cb0f74a73b8b22d3fc011667f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211efbf126cb0f74a73b8b22d3fc011667f 2023-02-11 09:55:36,933 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302111b3d9c6cb9914c7d9b083b357a2d2877 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302111b3d9c6cb9914c7d9b083b357a2d2877 2023-02-11 09:55:36,933 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,936 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,938 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,941 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,943 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,946 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,948 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,951 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,953 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,956 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,959 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,961 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a of snapshot=snaptb-1676109320648 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-11 09:55:36,973 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302119cc3389a0ad94b5089352c9c95809bfa_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302119cc3389a0ad94b5089352c9c95809bfa_del 2023-02-11 09:55:36,974 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112a463b965a324767adc8579a71b87d63_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302112a463b965a324767adc8579a71b87d63_del 2023-02-11 09:55:36,975 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211beb88164846d4c2681dc8321d9ebe7e6_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230211beb88164846d4c2681dc8321d9ebe7e6_del 2023-02-11 09:55:36,975 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 016732cf600178157bb892db15fc6720 2023-02-11 09:55:36,975 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:36,975 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:36,979 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/df38524afdff4cc490e204bfdcea0db7_SeqId_29_ 2023-02-11 09:55:36,979 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/cb62bcc7c29b44fdb955834ee150e429_SeqId_29_ 2023-02-11 09:55:36,979 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/3bfa6a9325bd4d0e865f5393dfcd8bd9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/3bfa6a9325bd4d0e865f5393dfcd8bd9 2023-02-11 09:55:36,980 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/de9e0bee47784227969c2003f4c6d97f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/de9e0bee47784227969c2003f4c6d97f 2023-02-11 09:55:36,980 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b8d8cb7259a54ee5ad022c5ea8ac1f6e of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:36,980 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/50dd718be43f49b8aa92e9935c89200f_SeqId_29_ 2023-02-11 09:55:36,980 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5df6dda91d4c4933aedb64c00d719021 of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:36,980 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/b02cde5a2e584c658bd8ce61e740c4c6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/b02cde5a2e584c658bd8ce61e740c4c6 2023-02-11 09:55:36,980 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 17ef15046b2b4e978fe221839d947bbc of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:36,983 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b280196a0d3f466fa9c4118592feb68c of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:36,984 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 855dd55ad1e04f99a753f6d113131680 of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:36,984 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 69b01c8c34d44d5c9e49b28a8a14bee0 of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:36,987 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ecbfa7af5b0e4cf3bd19e913bd3be1e1 of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:36,988 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4b9695db81924c6cb0fc38c50ac5d131 of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:36,988 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 02ae6a603712431ab53184e65611217d of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:36,993 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a4e4313aa18240059b36f5b58678c6ca of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:36,993 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f9c63979f82a4e5f83b4947103ac9c2f of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:36,993 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e71d9cf93cf44f5eb70d741d75141c6e of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:36,998 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/03e2393acebb4d0ca5e88defa1c5ed27 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/03e2393acebb4d0ca5e88defa1c5ed27 2023-02-11 09:55:36,998 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink af2fdc0294df49fa98b68f182b7b03c5 of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:36,998 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/459a0c495bec4a34998828e8affb6aae to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/459a0c495bec4a34998828e8affb6aae 2023-02-11 09:55:36,998 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 811a9725477b40169a0212590b78e2f5 of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:36,998 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/ae02be8ea7c74c2ead8a1ea38726e287 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/ae02be8ea7c74c2ead8a1ea38726e287 2023-02-11 09:55:36,998 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6bb7b6921b15490eab5331c04010820b of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:37,001 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f043ca462ab64aec83e2e58c4bd03aab of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:37,001 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 42e1d84cfa1b4eda94472d8c2aba5cd7 of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:37,002 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b2756ae715384da8b69d35562fda985f of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:37,005 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 745a6d38c3e241659943d927a9902efd of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:37,005 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ffd25f32c3534f578fb43145c6f81ad4 of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:37,006 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 84448008f6584a218993cdce28788441 of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:37,008 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 17fa425c1a294e768afc0135eaf7c046 of snapshot=snaptb-1676109320648 to region=ffaa59391868e3b78654a134d119206a table=testCompactionWithHFileLink 2023-02-11 09:55:37,009 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 397df4713f6d4645b1af472026d7d8e0 of snapshot=snaptb-1676109320648 to region=016732cf600178157bb892db15fc6720 table=testCompactionWithHFileLink 2023-02-11 09:55:37,009 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f5586975da1843bea96c0899ba521d29 of snapshot=snaptb-1676109320648 to region=b9e6247c3c7f22b5fe2c5b9ec537ba6e table=testCompactionWithHFileLink 2023-02-11 09:55:37,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 09:55:37,013 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676109320648" table: "testCompactionWithHFileLink" creation_time: 1676109320658 type: FLUSH version: 2 ttl: 0 2023-02-11 09:55:37,014 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676109337014"}]},"ts":"9223372036854775807"} 2023-02-11 09:55:37,014 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676109337014"}]},"ts":"9223372036854775807"} 2023-02-11 09:55:37,014 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676109337014"}]},"ts":"9223372036854775807"} 2023-02-11 09:55:37,016 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-11 09:55:37,016 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 016732cf600178157bb892db15fc6720, NAME => 'testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b9e6247c3c7f22b5fe2c5b9ec537ba6e, NAME => 'testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => ffaa59391868e3b78654a134d119206a, NAME => 'testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.', STARTKEY => '2', ENDKEY => ''}] 2023-02-11 09:55:37,017 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109337015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109337015"}]},"ts":"1676109337015"} 2023-02-11 09:55:37,017 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109337015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109337015"}]},"ts":"1676109337015"} 2023-02-11 09:55:37,017 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109337015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109337015"}]},"ts":"1676109337015"} 2023-02-11 09:55:37,018 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 09:55:37,018 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-11 09:55:37,018 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 016732cf600178157bb892db15fc6720, NAME => 'testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b9e6247c3c7f22b5fe2c5b9ec537ba6e, NAME => 'testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => ffaa59391868e3b78654a134d119206a, NAME => 'testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.', STARTKEY => '2', ENDKEY => ''}] 2023-02-11 09:55:37,019 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676109320648 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-11 09:55:37,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676109320648" table: "testCompactionWithHFileLink" creation_time: 1676109320658 type: FLUSH version: 2 ttl: 0 ) in 124 msec 2023-02-11 09:55:37,046 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-11 09:55:37,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-11 09:55:37,213 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-11 09:55:37,213 INFO [Listener at localhost/44465] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:37,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1676109320648-1676109334745" 2023-02-11 09:55:37,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676109320648-1676109334745 2023-02-11 09:55:37,222 INFO [Listener at localhost/44465] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-11 09:55:37,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-11 09:55:37,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-11 09:55:37,237 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-11 09:55:37,237 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109337237"}]},"ts":"1676109337237"} 2023-02-11 09:55:37,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 09:55:37,238 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-11 09:55:37,240 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-11 09:55:37,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN}] 2023-02-11 09:55:37,242 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN 2023-02-11 09:55:37,242 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN 2023-02-11 09:55:37,242 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN 2023-02-11 09:55:37,242 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 09:55:37,242 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 09:55:37,242 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-11 09:55:37,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 09:55:37,394 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ffaa59391868e3b78654a134d119206a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:37,394 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b9e6247c3c7f22b5fe2c5b9ec537ba6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:37,394 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109337394"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109337394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109337394"}]},"ts":"1676109337394"} 2023-02-11 09:55:37,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109337394"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109337394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109337394"}]},"ts":"1676109337394"} 2023-02-11 09:55:37,394 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=016732cf600178157bb892db15fc6720, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:37,395 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109337394"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109337394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109337394"}]},"ts":"1676109337394"} 2023-02-11 09:55:37,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure ffaa59391868e3b78654a134d119206a, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:37,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure b9e6247c3c7f22b5fe2c5b9ec537ba6e, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:37,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 016732cf600178157bb892db15fc6720, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:37,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 09:55:37,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:37,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b9e6247c3c7f22b5fe2c5b9ec537ba6e, NAME => 'testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 09:55:37,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:37,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,552 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,553 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:37,553 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:37,553 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9e6247c3c7f22b5fe2c5b9ec537ba6e columnFamilyName family1 2023-02-11 09:55:37,569 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-17ef15046b2b4e978fe221839d947bbc 2023-02-11 09:55:37,574 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-4b9695db81924c6cb0fc38c50ac5d131 2023-02-11 09:55:37,580 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-855dd55ad1e04f99a753f6d113131680 2023-02-11 09:55:37,585 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f9c63979f82a4e5f83b4947103ac9c2f 2023-02-11 09:55:37,585 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(310): Store=b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:37,585 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,586 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 2023-02-11 09:55:37,586 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 2023-02-11 09:55:37,586 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9e6247c3c7f22b5fe2c5b9ec537ba6e columnFamilyName family2 2023-02-11 09:55:37,593 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-6bb7b6921b15490eab5331c04010820b 2023-02-11 09:55:37,598 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-84448008f6584a218993cdce28788441 2023-02-11 09:55:37,604 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-b2756ae715384da8b69d35562fda985f 2023-02-11 09:55:37,610 DEBUG [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f5586975da1843bea96c0899ba521d29 2023-02-11 09:55:37,610 INFO [StoreOpener-b9e6247c3c7f22b5fe2c5b9ec537ba6e-1] regionserver.HStore(310): Store=b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:37,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:37,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:55:37,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b9e6247c3c7f22b5fe2c5b9ec537ba6e; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65363846, jitterRate=-0.02600279450416565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:37,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: Running coprocessor pre-open hook at 1676109337551Writing region info on filesystem at 1676109337551Initializing all the Stores at 1676109337551Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109337552 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109337552Cleaning up temporary data from old regions at 1676109337612 (+60 ms)Cleaning up detritus from prior splits at 1676109337613 (+1 ms)Running coprocessor post-open hooks at 1676109337616 (+3 ms)Region opened successfully at 1676109337616 2023-02-11 09:55:37,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e., pid=102, masterSystemTime=1676109337548 2023-02-11 09:55:37,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:55:37,618 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 09:55:37,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-11 09:55:37,618 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 09:55:37,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:37,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:37,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:37,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 016732cf600178157bb892db15fc6720, NAME => 'testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 09:55:37,619 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b9e6247c3c7f22b5fe2c5b9ec537ba6e, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:37,620 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109337619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109337619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109337619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109337619"}]},"ts":"1676109337619"} 2023-02-11 09:55:37,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:37,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,621 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 09:55:37,621 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1912): b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 is initiating minor compaction (all files) 2023-02-11 09:55:37,621 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 in testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:37,621 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-17ef15046b2b4e978fe221839d947bbc, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-855dd55ad1e04f99a753f6d113131680, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-4b9695db81924c6cb0fc38c50ac5d131, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f9c63979f82a4e5f83b4947103ac9c2f] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp, totalSize=21.6 K 2023-02-11 09:55:37,622 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 09:55:37,622 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1912): b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 is initiating minor compaction (all files) 2023-02-11 09:55:37,622 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,622 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegion(2258): Starting compaction of b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 in testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:55:37,622 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-6bb7b6921b15490eab5331c04010820b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-b2756ae715384da8b69d35562fda985f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-84448008f6584a218993cdce28788441, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f5586975da1843bea96c0899ba521d29] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp, totalSize=20.4 K 2023-02-11 09:55:37,623 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-17ef15046b2b4e978fe221839d947bbc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:37,623 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:37,623 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:37,623 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-6bb7b6921b15490eab5331c04010820b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:37,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=99 2023-02-11 09:55:37,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure b9e6247c3c7f22b5fe2c5b9ec537ba6e, server=jenkins-hbase4.apache.org,43463,1676109215499 in 224 msec 2023-02-11 09:55:37,623 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 016732cf600178157bb892db15fc6720 columnFamilyName family1 2023-02-11 09:55:37,624 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-855dd55ad1e04f99a753f6d113131680, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:37,624 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-b2756ae715384da8b69d35562fda985f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:37,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b9e6247c3c7f22b5fe2c5b9ec537ba6e, ASSIGN in 383 msec 2023-02-11 09:55:37,624 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-4b9695db81924c6cb0fc38c50ac5d131, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:37,625 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-84448008f6584a218993cdce28788441, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:37,625 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f9c63979f82a4e5f83b4947103ac9c2f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:37,626 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f5586975da1843bea96c0899ba521d29, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:37,640 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-a4e4313aa18240059b36f5b58678c6ca 2023-02-11 09:55:37,648 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b280196a0d3f466fa9c4118592feb68c 2023-02-11 09:55:37,662 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b8d8cb7259a54ee5ad022c5ea8ac1f6e 2023-02-11 09:55:37,665 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): b9e6247c3c7f22b5fe2c5b9ec537ba6e#family1#compaction#114 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:37,667 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] throttle.PressureAwareThroughputController(145): b9e6247c3c7f22b5fe2c5b9ec537ba6e#family2#compaction#115 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:37,685 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ecbfa7af5b0e4cf3bd19e913bd3be1e1 2023-02-11 09:55:37,685 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(310): Store=016732cf600178157bb892db15fc6720/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:37,685 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,687 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2 2023-02-11 09:55:37,687 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2 2023-02-11 09:55:37,687 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 016732cf600178157bb892db15fc6720 columnFamilyName family2 2023-02-11 09:55:37,695 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-397df4713f6d4645b1af472026d7d8e0 2023-02-11 09:55:37,700 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-af2fdc0294df49fa98b68f182b7b03c5 2023-02-11 09:55:37,704 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-f043ca462ab64aec83e2e58c4bd03aab 2023-02-11 09:55:37,709 DEBUG [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ffd25f32c3534f578fb43145c6f81ad4 2023-02-11 09:55:37,710 INFO [StoreOpener-016732cf600178157bb892db15fc6720-1] regionserver.HStore(310): Store=016732cf600178157bb892db15fc6720/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:37,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:37,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 016732cf600178157bb892db15fc6720 2023-02-11 09:55:37,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 016732cf600178157bb892db15fc6720; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61377034, jitterRate=-0.08541092276573181}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:37,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 016732cf600178157bb892db15fc6720: Running coprocessor pre-open hook at 1676109337620Writing region info on filesystem at 1676109337620Initializing all the Stores at 1676109337621 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109337621Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109337622 (+1 ms)Cleaning up temporary data from old regions at 1676109337713 (+91 ms)Cleaning up detritus from prior splits at 1676109337713Running coprocessor post-open hooks at 1676109337716 (+3 ms)Region opened successfully at 1676109337716 2023-02-11 09:55:37,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720., pid=103, masterSystemTime=1676109337548 2023-02-11 09:55:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-11 09:55:37,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-11 09:55:37,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:37,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:37,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:37,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ffaa59391868e3b78654a134d119206a, NAME => 'testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 09:55:37,719 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=016732cf600178157bb892db15fc6720, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:37,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:37,719 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109337719"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109337719"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109337719"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109337719"}]},"ts":"1676109337719"} 2023-02-11 09:55:37,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,720 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,721 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:37,722 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:37,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-11 09:55:37,722 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffaa59391868e3b78654a134d119206a columnFamilyName family1 2023-02-11 09:55:37,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 016732cf600178157bb892db15fc6720, server=jenkins-hbase4.apache.org,43463,1676109215499 in 323 msec 2023-02-11 09:55:37,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=016732cf600178157bb892db15fc6720, ASSIGN in 482 msec 2023-02-11 09:55:37,733 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-02ae6a603712431ab53184e65611217d 2023-02-11 09:55:37,738 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-5df6dda91d4c4933aedb64c00d719021 2023-02-11 09:55:37,745 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-69b01c8c34d44d5c9e49b28a8a14bee0 2023-02-11 09:55:37,759 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-e71d9cf93cf44f5eb70d741d75141c6e 2023-02-11 09:55:37,759 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(310): Store=ffaa59391868e3b78654a134d119206a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:37,760 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,763 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2 2023-02-11 09:55:37,763 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2 2023-02-11 09:55:37,764 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffaa59391868e3b78654a134d119206a columnFamilyName family2 2023-02-11 09:55:37,784 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-17fa425c1a294e768afc0135eaf7c046 2023-02-11 09:55:37,792 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-42e1d84cfa1b4eda94472d8c2aba5cd7 2023-02-11 09:55:37,799 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-745a6d38c3e241659943d927a9902efd 2023-02-11 09:55:37,805 DEBUG [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(539): loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-811a9725477b40169a0212590b78e2f5 2023-02-11 09:55:37,805 INFO [StoreOpener-ffaa59391868e3b78654a134d119206a-1] regionserver.HStore(310): Store=ffaa59391868e3b78654a134d119206a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:37,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:37,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ffaa59391868e3b78654a134d119206a 2023-02-11 09:55:37,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ffaa59391868e3b78654a134d119206a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69058684, jitterRate=0.029054582118988037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:37,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ffaa59391868e3b78654a134d119206a: Running coprocessor pre-open hook at 1676109337719Writing region info on filesystem at 1676109337719Initializing all the Stores at 1676109337720 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109337720Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109337720Cleaning up temporary data from old regions at 1676109337807 (+87 ms)Cleaning up detritus from prior splits at 1676109337807Running coprocessor post-open hooks at 1676109337810 (+3 ms)Region opened successfully at 1676109337810 2023-02-11 09:55:37,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a., pid=101, masterSystemTime=1676109337548 2023-02-11 09:55:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-11 09:55:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-11 09:55:37,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:37,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:37,813 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ffaa59391868e3b78654a134d119206a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:37,813 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676109337812"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109337812"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109337812"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109337812"}]},"ts":"1676109337812"} 2023-02-11 09:55:37,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-02-11 09:55:37,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure ffaa59391868e3b78654a134d119206a, server=jenkins-hbase4.apache.org,43463,1676109215499 in 418 msec 2023-02-11 09:55:37,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-02-11 09:55:37,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ffaa59391868e3b78654a134d119206a, ASSIGN in 576 msec 2023-02-11 09:55:37,818 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109337817"}]},"ts":"1676109337817"} 2023-02-11 09:55:37,819 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-11 09:55:37,820 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-11 09:55:37,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 593 msec 2023-02-11 09:55:37,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-11 09:55:37,840 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-11 09:55:37,856 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:37,865 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:37,874 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:37,876 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:37,883 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 09:55:37,900 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-11 09:55:37,901 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:37,901 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(139): Connect 0x37a80859 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:37,905 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e3fedf9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:37,905 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:37,905 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:37,905 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:37,973 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302119fb173ca1158422a878b776784bf948a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302119fb173ca1158422a878b776784bf948a 2023-02-11 09:55:37,974 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:37,986 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:37,989 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:37,995 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:55:37,998 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56056, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:55:38,008 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/2b0d9288caf845ae9e9b37524d52c255 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-11 09:55:38,009 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=32 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/2b0d9288caf845ae9e9b37524d52c255}] 2023-02-11 09:55:38,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/2b0d9288caf845ae9e9b37524d52c255 for inclusion in 016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:38,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-11 09:55:38,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 09:55:38,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:38,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211/family1/2b0d9288caf845ae9e9b37524d52c255 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__p211ho5pkl8ft8i4sp5v8tug5hs8imcnjih0nhigeia8rhc6feiuio3fgk351es1/family1/2b0d9288caf845ae9e9b37524d52c255 2023-02-11 09:55:38,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__p211ho5pkl8ft8i4sp5v8tug5hs8imcnjih0nhigeia8rhc6feiuio3fgk351es1/family1/2b0d9288caf845ae9e9b37524d52c255 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_ 2023-02-11 09:55:38,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__p211ho5pkl8ft8i4sp5v8tug5hs8imcnjih0nhigeia8rhc6feiuio3fgk351es1/family1/2b0d9288caf845ae9e9b37524d52c255 into 016732cf600178157bb892db15fc6720/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_ - updating store file list. 2023-02-11 09:55:38,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_ into 016732cf600178157bb892db15fc6720/family1 2023-02-11 09:55:38,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__p211ho5pkl8ft8i4sp5v8tug5hs8imcnjih0nhigeia8rhc6feiuio3fgk351es1/family1/2b0d9288caf845ae9e9b37524d52c255 into 016732cf600178157bb892db15fc6720/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_) 2023-02-11 09:55:38,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__p211ho5pkl8ft8i4sp5v8tug5hs8imcnjih0nhigeia8rhc6feiuio3fgk351es1/family1/2b0d9288caf845ae9e9b37524d52c255 2023-02-11 09:55:38,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:38,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-11 09:55:38,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(1912): 016732cf600178157bb892db15fc6720/family1 is initiating minor compaction (all files) 2023-02-11 09:55:38,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@905b303; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 09:55:38,029 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:38,030 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:38,031 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211084b344144d041b19a92255044824d62 2023-02-11 09:55:38,032 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021169262713bfdf47eb9bf3ae9d14455fd5 2023-02-11 09:55:38,033 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211ac5da309e8084e6e8a5937e97af9dd81 2023-02-11 09:55:38,034 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230211c64f189395774bb98891f5401b7d211a 2023-02-11 09:55:38,034 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 09:55:38,034 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 09:55:38,035 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:38,378 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021142a8156e72994b2397a1e9d0c144535b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023021142a8156e72994b2397a1e9d0c144535b 2023-02-11 09:55:38,378 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ed8761b5e00a413b9bb707b773ee80f6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230211ed8761b5e00a413b9bb707b773ee80f6 2023-02-11 09:55:38,379 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:38,379 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:38,411 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/5ba06dbe951b465bb9c51e17439dbd8c first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-11 09:55:38,412 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/788acaa5b95e4c27b5583df50735ce71 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-11 09:55:38,412 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/5ba06dbe951b465bb9c51e17439dbd8c}] 2023-02-11 09:55:38,412 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/788acaa5b95e4c27b5583df50735ce71}] 2023-02-11 09:55:38,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/788acaa5b95e4c27b5583df50735ce71 for inclusion in b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:38,415 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/5ba06dbe951b465bb9c51e17439dbd8c for inclusion in ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:38,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-11 09:55:38,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 09:55:38,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-11 09:55:38,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 09:55:38,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:38,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:38,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211/family1/5ba06dbe951b465bb9c51e17439dbd8c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ctd05p9bej39h0ohanmt6vfu1a8n842p3icl88roeauovge0dq9bdrcso487jolh/family1/5ba06dbe951b465bb9c51e17439dbd8c 2023-02-11 09:55:38,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211/family1/788acaa5b95e4c27b5583df50735ce71 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__heohfg98sfu59insunkbk9rkbrihq0s26l5v750o2m124vrhbo8vekenuavg94ts/family1/788acaa5b95e4c27b5583df50735ce71 2023-02-11 09:55:38,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__heohfg98sfu59insunkbk9rkbrihq0s26l5v750o2m124vrhbo8vekenuavg94ts/family1/788acaa5b95e4c27b5583df50735ce71 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/0991e403e2bf48f4beae3bef21d93109_SeqId_34_ 2023-02-11 09:55:38,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ctd05p9bej39h0ohanmt6vfu1a8n842p3icl88roeauovge0dq9bdrcso487jolh/family1/5ba06dbe951b465bb9c51e17439dbd8c as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_ 2023-02-11 09:55:38,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__heohfg98sfu59insunkbk9rkbrihq0s26l5v750o2m124vrhbo8vekenuavg94ts/family1/788acaa5b95e4c27b5583df50735ce71 into b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/0991e403e2bf48f4beae3bef21d93109_SeqId_34_ - updating store file list. 2023-02-11 09:55:38,423 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ctd05p9bej39h0ohanmt6vfu1a8n842p3icl88roeauovge0dq9bdrcso487jolh/family1/5ba06dbe951b465bb9c51e17439dbd8c into ffaa59391868e3b78654a134d119206a/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_ - updating store file list. 2023-02-11 09:55:38,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/0991e403e2bf48f4beae3bef21d93109_SeqId_34_ into b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 2023-02-11 09:55:38,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__heohfg98sfu59insunkbk9rkbrihq0s26l5v750o2m124vrhbo8vekenuavg94ts/family1/788acaa5b95e4c27b5583df50735ce71 into b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/0991e403e2bf48f4beae3bef21d93109_SeqId_34_) 2023-02-11 09:55:38,427 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_ into ffaa59391868e3b78654a134d119206a/family1 2023-02-11 09:55:38,427 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ctd05p9bej39h0ohanmt6vfu1a8n842p3icl88roeauovge0dq9bdrcso487jolh/family1/5ba06dbe951b465bb9c51e17439dbd8c into ffaa59391868e3b78654a134d119206a/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_) 2023-02-11 09:55:38,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__heohfg98sfu59insunkbk9rkbrihq0s26l5v750o2m124vrhbo8vekenuavg94ts/family1/788acaa5b95e4c27b5583df50735ce71 2023-02-11 09:55:38,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testCompactionWithHFileLink__ctd05p9bej39h0ohanmt6vfu1a8n842p3icl88roeauovge0dq9bdrcso487jolh/family1/5ba06dbe951b465bb9c51e17439dbd8c 2023-02-11 09:55:38,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:38,429 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:38,430 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:38,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-11 09:55:38,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(1912): ffaa59391868e3b78654a134d119206a/family1 is initiating minor compaction (all files) 2023-02-11 09:55:38,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1f053e58; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-11 09:55:38,431 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021100bc634f6a6840caac39c73c4a78e367 2023-02-11 09:55:38,433 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023021122399e31ad5b4efa84c4869dafbd321a 2023-02-11 09:55:38,433 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:38,434 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:38,434 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302115af579e5c0684c369288a5344670854a 2023-02-11 09:55:38,435 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230211e22f0c91a1944ca3abe338187a8f2a82 2023-02-11 09:55:38,435 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 09:55:38,435 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 09:55:38,435 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021101b4fac8d24f4d099c0289390868233a 2023-02-11 09:55:38,435 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:38,437 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211658551bb98dd4008b3a702d5d003352f 2023-02-11 09:55:38,438 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211a33b92bd858c45d196dfadc13f899ee6 2023-02-11 09:55:38,439 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230211ee61e37c0e2947138b9305fec5e3ba95 2023-02-11 09:55:38,439 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-11 09:55:38,439 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 09:55:38,439 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testCompactionWithHFileLink' and column='family1' 2023-02-11 09:55:38,439 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-11 09:55:38,443 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:38,446 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:38,448 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:38,449 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:38,454 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:38,455 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:38,471 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=288 (was 247) - Thread LEAK? -, OpenFileDescriptor=764 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=105 (was 160), ProcessCount=174 (was 174), AvailableMemoryMB=2522 (was 2616) 2023-02-11 09:55:38,484 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=288, OpenFileDescriptor=764, MaxFileDescriptor=60000, SystemLoadAverage=105, ProcessCount=174, AvailableMemoryMB=2521 2023-02-11 09:55:38,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-11 09:55:38,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-11 09:55:38,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-11 09:55:38,495 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 09:55:38,499 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family1/a3fd42f669614a2ca082ac4e8a7f3688 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/a3fd42f669614a2ca082ac4e8a7f3688 2023-02-11 09:55:38,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-02-11 09:55:38,500 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/.tmp/family2/fedea01f83904d91987fd25650f118d6 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/fedea01f83904d91987fd25650f118d6 2023-02-11 09:55:38,503 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-11 09:55:38,503 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1 of b9e6247c3c7f22b5fe2c5b9ec537ba6e into a3fd42f669614a2ca082ac4e8a7f3688(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:38,503 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:38,503 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e., storeName=b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1, priority=12, startTime=1676109337617; duration=0sec 2023-02-11 09:55:38,503 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-11 09:55:38,503 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 016732cf600178157bb892db15fc6720/family1 in testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:38,504 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b8d8cb7259a54ee5ad022c5ea8ac1f6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b280196a0d3f466fa9c4118592feb68c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ecbfa7af5b0e4cf3bd19e913bd3be1e1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-a4e4313aa18240059b36f5b58678c6ca, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp, totalSize=28.9 K 2023-02-11 09:55:38,504 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2 of b9e6247c3c7f22b5fe2c5b9ec537ba6e into fedea01f83904d91987fd25650f118d6(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:38,504 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: 2023-02-11 09:55:38,504 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e., storeName=b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2, priority=12, startTime=1676109337618; duration=0sec 2023-02-11 09:55:38,505 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-11 09:55:38,505 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegion(2258): Starting compaction of ffaa59391868e3b78654a134d119206a/family1 in testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:38,505 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-5df6dda91d4c4933aedb64c00d719021, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-69b01c8c34d44d5c9e49b28a8a14bee0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-02ae6a603712431ab53184e65611217d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-e71d9cf93cf44f5eb70d741d75141c6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp, totalSize=28.9 K 2023-02-11 09:55:38,505 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b8d8cb7259a54ee5ad022c5ea8ac1f6e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314675 2023-02-11 09:55:38,505 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-5df6dda91d4c4933aedb64c00d719021, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:38,505 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b280196a0d3f466fa9c4118592feb68c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:38,506 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-69b01c8c34d44d5c9e49b28a8a14bee0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:38,506 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ecbfa7af5b0e4cf3bd19e913bd3be1e1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:38,506 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-02ae6a603712431ab53184e65611217d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:38,506 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-a4e4313aa18240059b36f5b58678c6ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320055 2023-02-11 09:55:38,506 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676109314675 2023-02-11 09:55:38,506 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-e71d9cf93cf44f5eb70d741d75141c6e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:38,507 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting 116f264ad8ba4b549d09b27065029d8c_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676109314677 2023-02-11 09:55:38,518 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): 016732cf600178157bb892db15fc6720#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:38,518 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] throttle.PressureAwareThroughputController(145): ffaa59391868e3b78654a134d119206a#family1#compaction#117 average throughput is 2.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:38,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-17ef15046b2b4e978fe221839d947bbc, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-855dd55ad1e04f99a753f6d113131680, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-4b9695db81924c6cb0fc38c50ac5d131, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f9c63979f82a4e5f83b4947103ac9c2f] to archive 2023-02-11 09:55:38,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:38,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-17ef15046b2b4e978fe221839d947bbc to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-17ef15046b2b4e978fe221839d947bbc 2023-02-11 09:55:38,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-855dd55ad1e04f99a753f6d113131680 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-855dd55ad1e04f99a753f6d113131680 2023-02-11 09:55:38,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-4b9695db81924c6cb0fc38c50ac5d131 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-4b9695db81924c6cb0fc38c50ac5d131 2023-02-11 09:55:38,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f9c63979f82a4e5f83b4947103ac9c2f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family1/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f9c63979f82a4e5f83b4947103ac9c2f 2023-02-11 09:55:38,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-6bb7b6921b15490eab5331c04010820b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-b2756ae715384da8b69d35562fda985f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-84448008f6584a218993cdce28788441, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f5586975da1843bea96c0899ba521d29] to archive 2023-02-11 09:55:38,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:38,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-6bb7b6921b15490eab5331c04010820b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-6bb7b6921b15490eab5331c04010820b 2023-02-11 09:55:38,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-b2756ae715384da8b69d35562fda985f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-b2756ae715384da8b69d35562fda985f 2023-02-11 09:55:38,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-84448008f6584a218993cdce28788441 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-84448008f6584a218993cdce28788441 2023-02-11 09:55:38,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f5586975da1843bea96c0899ba521d29 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/family2/testCompactionWithHFileLink=b9e6247c3c7f22b5fe2c5b9ec537ba6e-f5586975da1843bea96c0899ba521d29 2023-02-11 09:55:38,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-11 09:55:38,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 09:55:38,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-11 09:55:38,598 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:55:38,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-11 09:55:38,599 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:55:38,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 09:55:38,601 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:38,601 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:38,601 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:38,602 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98 empty. 2023-02-11 09:55:38,602 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877 empty. 2023-02-11 09:55:38,602 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a empty. 2023-02-11 09:55:38,602 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:38,602 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:38,602 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:38,602 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-11 09:55:38,611 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-11 09:55:38,612 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => f2aa1f4e83b52c040476aa6bd5c21877, NAME => 'ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:38,613 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 468aeccb8d22c50304be9feb00b5922a, NAME => 'ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:38,613 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8ae1a139e38795e298a38629c4c20c98, NAME => 'ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:38,618 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:38,618 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 8ae1a139e38795e298a38629c4c20c98, disabling compactions & flushes 2023-02-11 09:55:38,619 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:38,619 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:38,619 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. after waiting 0 ms 2023-02-11 09:55:38,619 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:38,619 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:38,619 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 8ae1a139e38795e298a38629c4c20c98: Waiting for close lock at 1676109338618Disabling compacts and flushes for region at 1676109338618Disabling writes for close at 1676109338619 (+1 ms)Writing region close event to WAL at 1676109338619Closed at 1676109338619 2023-02-11 09:55:38,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 09:55:38,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing f2aa1f4e83b52c040476aa6bd5c21877, disabling compactions & flushes 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 468aeccb8d22c50304be9feb00b5922a, disabling compactions & flushes 2023-02-11 09:55:39,019 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,019 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. after waiting 0 ms 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. after waiting 0 ms 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,019 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,019 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,020 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,020 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 468aeccb8d22c50304be9feb00b5922a: Waiting for close lock at 1676109339019Disabling compacts and flushes for region at 1676109339019Disabling writes for close at 1676109339019Writing region close event to WAL at 1676109339019Closed at 1676109339019 2023-02-11 09:55:39,020 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for f2aa1f4e83b52c040476aa6bd5c21877: Waiting for close lock at 1676109339019Disabling compacts and flushes for region at 1676109339019Disabling writes for close at 1676109339019Writing region close event to WAL at 1676109339020 (+1 ms)Closed at 1676109339020 2023-02-11 09:55:39,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:55:39,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676109339022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109339022"}]},"ts":"1676109339022"} 2023-02-11 09:55:39,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676109339022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109339022"}]},"ts":"1676109339022"} 2023-02-11 09:55:39,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676109339022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109339022"}]},"ts":"1676109339022"} 2023-02-11 09:55:39,024 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 09:55:39,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:55:39,025 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109339025"}]},"ts":"1676109339025"} 2023-02-11 09:55:39,026 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-11 09:55:39,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8ae1a139e38795e298a38629c4c20c98, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=468aeccb8d22c50304be9feb00b5922a, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f2aa1f4e83b52c040476aa6bd5c21877, ASSIGN}] 2023-02-11 09:55:39,031 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f2aa1f4e83b52c040476aa6bd5c21877, ASSIGN 2023-02-11 09:55:39,031 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=468aeccb8d22c50304be9feb00b5922a, ASSIGN 2023-02-11 09:55:39,031 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8ae1a139e38795e298a38629c4c20c98, ASSIGN 2023-02-11 09:55:39,031 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f2aa1f4e83b52c040476aa6bd5c21877, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:39,032 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=468aeccb8d22c50304be9feb00b5922a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:39,032 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8ae1a139e38795e298a38629c4c20c98, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:39,184 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8ae1a139e38795e298a38629c4c20c98, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,184 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=f2aa1f4e83b52c040476aa6bd5c21877, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,184 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=468aeccb8d22c50304be9feb00b5922a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,184 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676109339184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109339184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109339184"}]},"ts":"1676109339184"} 2023-02-11 09:55:39,184 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676109339184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109339184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109339184"}]},"ts":"1676109339184"} 2023-02-11 09:55:39,184 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676109339184"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109339184"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109339184"}]},"ts":"1676109339184"} 2023-02-11 09:55:39,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 8ae1a139e38795e298a38629c4c20c98, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:39,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 468aeccb8d22c50304be9feb00b5922a, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:39,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure f2aa1f4e83b52c040476aa6bd5c21877, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:39,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 09:55:39,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f2aa1f4e83b52c040476aa6bd5c21877, NAME => 'ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 09:55:39,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:39,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,340 INFO [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,342 DEBUG [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1 2023-02-11 09:55:39,342 DEBUG [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1 2023-02-11 09:55:39,342 INFO [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2aa1f4e83b52c040476aa6bd5c21877 columnFamilyName family1 2023-02-11 09:55:39,343 INFO [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] regionserver.HStore(310): Store=f2aa1f4e83b52c040476aa6bd5c21877/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:39,344 INFO [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,345 DEBUG [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2 2023-02-11 09:55:39,345 DEBUG [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2 2023-02-11 09:55:39,345 INFO [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f2aa1f4e83b52c040476aa6bd5c21877 columnFamilyName family2 2023-02-11 09:55:39,346 INFO [StoreOpener-f2aa1f4e83b52c040476aa6bd5c21877-1] regionserver.HStore(310): Store=f2aa1f4e83b52c040476aa6bd5c21877/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:39,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:39,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:55:39,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:39,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f2aa1f4e83b52c040476aa6bd5c21877; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63645571, jitterRate=-0.05160708725452423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:39,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f2aa1f4e83b52c040476aa6bd5c21877: Running coprocessor pre-open hook at 1676109339339Writing region info on filesystem at 1676109339339Initializing all the Stores at 1676109339340 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109339340Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109339340Cleaning up temporary data from old regions at 1676109339347 (+7 ms)Cleaning up detritus from prior splits at 1676109339348 (+1 ms)Running coprocessor post-open hooks at 1676109339351 (+3 ms)Region opened successfully at 1676109339351 2023-02-11 09:55:39,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877., pid=111, masterSystemTime=1676109339337 2023-02-11 09:55:39,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 468aeccb8d22c50304be9feb00b5922a, NAME => 'ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 09:55:39,353 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=f2aa1f4e83b52c040476aa6bd5c21877, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,353 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676109339353"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109339353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109339353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109339353"}]},"ts":"1676109339353"} 2023-02-11 09:55:39,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:39,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,354 INFO [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,355 DEBUG [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1 2023-02-11 09:55:39,355 DEBUG [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1 2023-02-11 09:55:39,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-02-11 09:55:39,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure f2aa1f4e83b52c040476aa6bd5c21877, server=jenkins-hbase4.apache.org,43463,1676109215499 in 168 msec 2023-02-11 09:55:39,356 INFO [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 468aeccb8d22c50304be9feb00b5922a columnFamilyName family1 2023-02-11 09:55:39,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f2aa1f4e83b52c040476aa6bd5c21877, ASSIGN in 327 msec 2023-02-11 09:55:39,357 INFO [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] regionserver.HStore(310): Store=468aeccb8d22c50304be9feb00b5922a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:39,357 INFO [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,358 DEBUG [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2 2023-02-11 09:55:39,358 DEBUG [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2 2023-02-11 09:55:39,358 INFO [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 468aeccb8d22c50304be9feb00b5922a columnFamilyName family2 2023-02-11 09:55:39,359 INFO [StoreOpener-468aeccb8d22c50304be9feb00b5922a-1] regionserver.HStore(310): Store=468aeccb8d22c50304be9feb00b5922a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:39,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:39,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:55:39,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:39,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 468aeccb8d22c50304be9feb00b5922a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61378198, jitterRate=-0.08539357781410217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:39,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 468aeccb8d22c50304be9feb00b5922a: Running coprocessor pre-open hook at 1676109339354Writing region info on filesystem at 1676109339354Initializing all the Stores at 1676109339354Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109339354Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109339354Cleaning up temporary data from old regions at 1676109339360 (+6 ms)Cleaning up detritus from prior splits at 1676109339360Running coprocessor post-open hooks at 1676109339364 (+4 ms)Region opened successfully at 1676109339364 2023-02-11 09:55:39,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a., pid=110, masterSystemTime=1676109339337 2023-02-11 09:55:39,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8ae1a139e38795e298a38629c4c20c98, NAME => 'ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 09:55:39,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=468aeccb8d22c50304be9feb00b5922a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:39,366 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676109339366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109339366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109339366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109339366"}]},"ts":"1676109339366"} 2023-02-11 09:55:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,367 INFO [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,368 DEBUG [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1 2023-02-11 09:55:39,368 DEBUG [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1 2023-02-11 09:55:39,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=107 2023-02-11 09:55:39,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 468aeccb8d22c50304be9feb00b5922a, server=jenkins-hbase4.apache.org,43463,1676109215499 in 181 msec 2023-02-11 09:55:39,368 INFO [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ae1a139e38795e298a38629c4c20c98 columnFamilyName family1 2023-02-11 09:55:39,369 INFO [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] regionserver.HStore(310): Store=8ae1a139e38795e298a38629c4c20c98/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:39,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=468aeccb8d22c50304be9feb00b5922a, ASSIGN in 339 msec 2023-02-11 09:55:39,369 INFO [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,370 DEBUG [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2 2023-02-11 09:55:39,370 DEBUG [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2 2023-02-11 09:55:39,371 INFO [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8ae1a139e38795e298a38629c4c20c98 columnFamilyName family2 2023-02-11 09:55:39,371 INFO [StoreOpener-8ae1a139e38795e298a38629c4c20c98-1] regionserver.HStore(310): Store=8ae1a139e38795e298a38629c4c20c98/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:39,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:55:39,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:55:39,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:39,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8ae1a139e38795e298a38629c4c20c98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59432466, jitterRate=-0.11438724398612976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:55:39,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8ae1a139e38795e298a38629c4c20c98: Running coprocessor pre-open hook at 1676109339366Writing region info on filesystem at 1676109339366Initializing all the Stores at 1676109339367 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109339367Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109339367Cleaning up temporary data from old regions at 1676109339373 (+6 ms)Cleaning up detritus from prior splits at 1676109339373Running coprocessor post-open hooks at 1676109339376 (+3 ms)Region opened successfully at 1676109339376 2023-02-11 09:55:39,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98., pid=109, masterSystemTime=1676109339337 2023-02-11 09:55:39,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:39,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:39,378 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=8ae1a139e38795e298a38629c4c20c98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,379 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676109339378"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109339378"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109339378"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109339378"}]},"ts":"1676109339378"} 2023-02-11 09:55:39,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-02-11 09:55:39,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 8ae1a139e38795e298a38629c4c20c98, server=jenkins-hbase4.apache.org,43463,1676109215499 in 195 msec 2023-02-11 09:55:39,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-02-11 09:55:39,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=8ae1a139e38795e298a38629c4c20c98, ASSIGN in 352 msec 2023-02-11 09:55:39,382 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:55:39,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109339382"}]},"ts":"1676109339382"} 2023-02-11 09:55:39,383 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-11 09:55:39,386 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:55:39,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 790 msec 2023-02-11 09:55:39,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-11 09:55:39,703 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-11 09:55:39,708 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:39,709 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:39,709 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:39,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:39,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 09:55:39,712 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 09:55:39,712 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:39,712 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 09:55:39,712 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 09:55:39,713 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:39,713 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:39,714 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:39,714 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:39,714 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:39,714 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:39,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:39,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 09:55:39,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 09:55:39,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 09:55:39,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:39,715 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 09:55:39,715 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,715 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. started... 2023-02-11 09:55:39,717 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 468aeccb8d22c50304be9feb00b5922a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:55:39,717 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:39,717 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:39,717 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:39,717 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:39,718 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. started... 2023-02-11 09:55:39,718 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. started... 2023-02-11 09:55:39,718 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f2aa1f4e83b52c040476aa6bd5c21877 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:55:39,718 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ae1a139e38795e298a38629c4c20c98 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:55:39,737 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family1/8c6b0cade835408fae1cb7c2104badc2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/8c6b0cade835408fae1cb7c2104badc2 2023-02-11 09:55:39,737 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family1/a4ac40c648c34d3a9c6b09221d058eec as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/a4ac40c648c34d3a9c6b09221d058eec 2023-02-11 09:55:39,737 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211b9372eca7cd24008b45d8fb9df56eff6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211b9372eca7cd24008b45d8fb9df56eff6 2023-02-11 09:55:39,741 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in ffaa59391868e3b78654a134d119206a/family1 of ffaa59391868e3b78654a134d119206a into 8c6b0cade835408fae1cb7c2104badc2(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:39,741 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 016732cf600178157bb892db15fc6720/family1 of 016732cf600178157bb892db15fc6720 into a4ac40c648c34d3a9c6b09221d058eec(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:39,741 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:39,741 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:39,741 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676109338431; duration=1sec 2023-02-11 09:55:39,741 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676109338027; duration=1sec 2023-02-11 09:55:39,741 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-11 09:55:39,742 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-11 09:55:39,742 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 09:55:39,742 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 09:55:39,742 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/17be38c886024888b3462ccf73120604 2023-02-11 09:55:39,744 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 09:55:39,744 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 09:55:39,744 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1912): ffaa59391868e3b78654a134d119206a/family2 is initiating minor compaction (all files) 2023-02-11 09:55:39,744 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1912): 016732cf600178157bb892db15fc6720/family2 is initiating minor compaction (all files) 2023-02-11 09:55:39,744 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ffaa59391868e3b78654a134d119206a/family2 in testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:55:39,744 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 016732cf600178157bb892db15fc6720/family2 in testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:55:39,744 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-811a9725477b40169a0212590b78e2f5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-42e1d84cfa1b4eda94472d8c2aba5cd7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-745a6d38c3e241659943d927a9902efd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-17fa425c1a294e768afc0135eaf7c046] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp, totalSize=20.4 K 2023-02-11 09:55:39,744 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-af2fdc0294df49fa98b68f182b7b03c5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-f043ca462ab64aec83e2e58c4bd03aab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ffd25f32c3534f578fb43145c6f81ad4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-397df4713f6d4645b1af472026d7d8e0] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp, totalSize=20.4 K 2023-02-11 09:55:39,745 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-811a9725477b40169a0212590b78e2f5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314677 2023-02-11 09:55:39,745 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-af2fdc0294df49fa98b68f182b7b03c5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109314675 2023-02-11 09:55:39,746 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-42e1d84cfa1b4eda94472d8c2aba5cd7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:39,746 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-f043ca462ab64aec83e2e58c4bd03aab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109316457 2023-02-11 09:55:39,746 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-745a6d38c3e241659943d927a9902efd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:39,746 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ffd25f32c3534f578fb43145c6f81ad4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109318268 2023-02-11 09:55:39,747 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-17fa425c1a294e768afc0135eaf7c046, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320056 2023-02-11 09:55:39,747 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-397df4713f6d4645b1af472026d7d8e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109320055 2023-02-11 09:55:39,755 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211167079ac9aa04b51a3e56d0bc2512d9a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230211167079ac9aa04b51a3e56d0bc2512d9a 2023-02-11 09:55:39,759 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/8c6e1427a22b406498b361de62853c1b 2023-02-11 09:55:39,760 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] throttle.PressureAwareThroughputController(145): 016732cf600178157bb892db15fc6720#family2#compaction#122 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:39,760 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): ffaa59391868e3b78654a134d119206a#family2#compaction#123 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:39,764 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/17be38c886024888b3462ccf73120604 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/17be38c886024888b3462ccf73120604 2023-02-11 09:55:39,767 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/17be38c886024888b3462ccf73120604, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 09:55:39,767 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/8c6e1427a22b406498b361de62853c1b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/8c6e1427a22b406498b361de62853c1b 2023-02-11 09:55:39,770 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/8c6e1427a22b406498b361de62853c1b, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:55:39,771 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 468aeccb8d22c50304be9feb00b5922a in 54ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:39,771 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-11 09:55:39,771 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:39,771 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:39,771 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:39,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b8d8cb7259a54ee5ad022c5ea8ac1f6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b280196a0d3f466fa9c4118592feb68c, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ecbfa7af5b0e4cf3bd19e913bd3be1e1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-a4e4313aa18240059b36f5b58678c6ca, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_] to archive 2023-02-11 09:55:39,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:39,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b8d8cb7259a54ee5ad022c5ea8ac1f6e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b8d8cb7259a54ee5ad022c5ea8ac1f6e 2023-02-11 09:55:39,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b280196a0d3f466fa9c4118592feb68c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-b280196a0d3f466fa9c4118592feb68c 2023-02-11 09:55:39,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ecbfa7af5b0e4cf3bd19e913bd3be1e1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ecbfa7af5b0e4cf3bd19e913bd3be1e1 2023-02-11 09:55:39,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-a4e4313aa18240059b36f5b58678c6ca to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-a4e4313aa18240059b36f5b58678c6ca 2023-02-11 09:55:39,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family1/d003df1cf6ca43bb85d722475c2ba43b_SeqId_34_ 2023-02-11 09:55:39,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-5df6dda91d4c4933aedb64c00d719021, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-69b01c8c34d44d5c9e49b28a8a14bee0, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-02ae6a603712431ab53184e65611217d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-e71d9cf93cf44f5eb70d741d75141c6e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_] to archive 2023-02-11 09:55:39,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:39,848 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-5df6dda91d4c4933aedb64c00d719021 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-5df6dda91d4c4933aedb64c00d719021 2023-02-11 09:55:39,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-69b01c8c34d44d5c9e49b28a8a14bee0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-69b01c8c34d44d5c9e49b28a8a14bee0 2023-02-11 09:55:39,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-02ae6a603712431ab53184e65611217d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-02ae6a603712431ab53184e65611217d 2023-02-11 09:55:39,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-e71d9cf93cf44f5eb70d741d75141c6e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-e71d9cf93cf44f5eb70d741d75141c6e 2023-02-11 09:55:39,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family1/116f264ad8ba4b549d09b27065029d8c_SeqId_34_ 2023-02-11 09:55:39,984 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:55:40,133 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211e40970c43a9642858dca46e8bde5889e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211e40970c43a9642858dca46e8bde5889e 2023-02-11 09:55:40,133 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211e94a40d90f944c0e92ae90deacb3cea6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211e94a40d90f944c0e92ae90deacb3cea6 2023-02-11 09:55:40,538 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/1d79fa818b33437e8c258cdf6962f601 2023-02-11 09:55:40,538 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/8e508e4f7fd14f64aff9f002c38337c4 2023-02-11 09:55:40,957 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b7d0c87036d442f986ecd2a4ca017b44 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230211b7d0c87036d442f986ecd2a4ca017b44 2023-02-11 09:55:40,957 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302113665b314688841b9a0eabc2576151444 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302113665b314688841b9a0eabc2576151444 2023-02-11 09:55:40,961 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/0707fd879f034228885add85b06acbb6 2023-02-11 09:55:40,965 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/8e508e4f7fd14f64aff9f002c38337c4 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/8e508e4f7fd14f64aff9f002c38337c4 2023-02-11 09:55:40,968 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/8e508e4f7fd14f64aff9f002c38337c4, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 09:55:40,968 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/0707fd879f034228885add85b06acbb6 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/0707fd879f034228885add85b06acbb6 2023-02-11 09:55:40,971 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/0707fd879f034228885add85b06acbb6, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:55:40,972 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8ae1a139e38795e298a38629c4c20c98 in 1254ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:40,972 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:40,972 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:40,972 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:40,978 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/.tmp/family2/4b2ff7afb2f840fb8e63d99f617c92f9 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/4b2ff7afb2f840fb8e63d99f617c92f9 2023-02-11 09:55:40,978 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/.tmp/family2/52d17731c30c463a89aeba3410b1df1d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/52d17731c30c463a89aeba3410b1df1d 2023-02-11 09:55:40,982 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 016732cf600178157bb892db15fc6720/family2 of 016732cf600178157bb892db15fc6720 into 4b2ff7afb2f840fb8e63d99f617c92f9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:40,982 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in ffaa59391868e3b78654a134d119206a/family2 of ffaa59391868e3b78654a134d119206a into 52d17731c30c463a89aeba3410b1df1d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:40,982 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 016732cf600178157bb892db15fc6720: 2023-02-11 09:55:40,982 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ffaa59391868e3b78654a134d119206a: 2023-02-11 09:55:40,982 INFO [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720., storeName=016732cf600178157bb892db15fc6720/family2, priority=12, startTime=1676109337717; duration=1sec 2023-02-11 09:55:40,982 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a., storeName=ffaa59391868e3b78654a134d119206a/family2, priority=12, startTime=1676109337811; duration=1sec 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. because compaction request was cancelled 2023-02-11 09:55:40,983 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. because compaction request was cancelled 2023-02-11 09:55:41,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-af2fdc0294df49fa98b68f182b7b03c5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-f043ca462ab64aec83e2e58c4bd03aab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ffd25f32c3534f578fb43145c6f81ad4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-397df4713f6d4645b1af472026d7d8e0] to archive 2023-02-11 09:55:41,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:41,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-af2fdc0294df49fa98b68f182b7b03c5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-af2fdc0294df49fa98b68f182b7b03c5 2023-02-11 09:55:41,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-f043ca462ab64aec83e2e58c4bd03aab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-f043ca462ab64aec83e2e58c4bd03aab 2023-02-11 09:55:41,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ffd25f32c3534f578fb43145c6f81ad4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-ffd25f32c3534f578fb43145c6f81ad4 2023-02-11 09:55:41,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-397df4713f6d4645b1af472026d7d8e0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/family2/testCompactionWithHFileLink=016732cf600178157bb892db15fc6720-397df4713f6d4645b1af472026d7d8e0 2023-02-11 09:55:41,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-811a9725477b40169a0212590b78e2f5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-42e1d84cfa1b4eda94472d8c2aba5cd7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-745a6d38c3e241659943d927a9902efd, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-17fa425c1a294e768afc0135eaf7c046] to archive 2023-02-11 09:55:41,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:41,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-811a9725477b40169a0212590b78e2f5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-811a9725477b40169a0212590b78e2f5 2023-02-11 09:55:41,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-42e1d84cfa1b4eda94472d8c2aba5cd7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-42e1d84cfa1b4eda94472d8c2aba5cd7 2023-02-11 09:55:41,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-745a6d38c3e241659943d927a9902efd to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-745a6d38c3e241659943d927a9902efd 2023-02-11 09:55:41,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-17fa425c1a294e768afc0135eaf7c046 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/family2/testCompactionWithHFileLink=ffaa59391868e3b78654a134d119206a-17fa425c1a294e768afc0135eaf7c046 2023-02-11 09:55:41,361 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/9c1b4048492040e08e116b85402efd8e 2023-02-11 09:55:41,365 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/1d79fa818b33437e8c258cdf6962f601 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/1d79fa818b33437e8c258cdf6962f601 2023-02-11 09:55:41,369 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/1d79fa818b33437e8c258cdf6962f601, entries=4, sequenceid=5, filesize=5.4 K 2023-02-11 09:55:41,370 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/9c1b4048492040e08e116b85402efd8e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/9c1b4048492040e08e116b85402efd8e 2023-02-11 09:55:41,373 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/9c1b4048492040e08e116b85402efd8e, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:55:41,373 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f2aa1f4e83b52c040476aa6bd5c21877 in 1655ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:41,374 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:41,374 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:41,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:41,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:41,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 09:55:41,374 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 09:55:41,375 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,375 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:41,376 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,376 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:41,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:41,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 09:55:41,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41c86288[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:41,377 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 09:55:41,377 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,378 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,379 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 09:55:41,379 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 09:55:41,379 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:41,379 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,379 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:41,381 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,381 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 09:55:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:41,381 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:41,382 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 09:55:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:41,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:41,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 09:55:41,384 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 09:55:41,384 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:41,384 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:41,384 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 09:55:41,384 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:41,386 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,386 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:41,386 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:41,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:41,386 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:41,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:41,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:41,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,387 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:41,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:41,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,390 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:41,390 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:41,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:41,390 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:41,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 09:55:41,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:41,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:41,390 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:41,391 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:41,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 09:55:41,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:41,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:41,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:41,392 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,491 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:41,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:41,493 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:41,493 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:41,493 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:41,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:41,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:41,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 09:55:41,497 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 09:55:41,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:41,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 09:55:41,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 09:55:41,498 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,498 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:41,499 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:41,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:41,499 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,500 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:41,500 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:41,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:41,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:41,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:41,501 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 09:55:41,501 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 09:55:41,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 09:55:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 09:55:41,501 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 09:55:41,502 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:41,502 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. started... 2023-02-11 09:55:41,502 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:41,502 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. started... 2023-02-11 09:55:41,502 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 468aeccb8d22c50304be9feb00b5922a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:55:41,502 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ae1a139e38795e298a38629c4c20c98 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:55:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:41,503 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:41,503 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. started... 2023-02-11 09:55:41,503 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f2aa1f4e83b52c040476aa6bd5c21877 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:55:41,522 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021155d08c4d7cfa481e9fdcb6b055551b10 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021155d08c4d7cfa481e9fdcb6b055551b10 2023-02-11 09:55:41,523 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211651e752add7a432ea8ab7125e9667050 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211651e752add7a432ea8ab7125e9667050 2023-02-11 09:55:41,523 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211fdc670f2a2354d83bf6fb54ab2bc51b7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211fdc670f2a2354d83bf6fb54ab2bc51b7 2023-02-11 09:55:41,930 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/f51b37195438463baf31597a9a6108e2 2023-02-11 09:55:41,930 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/e9a3cd5ff11740129a7192ade766f033 2023-02-11 09:55:41,933 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/a09f4e7474674b2b9ec3f5bdf04a1df2 2023-02-11 09:55:42,344 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302115e25e6ad1df6422eb85b6b0df0c93d0b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302115e25e6ad1df6422eb85b6b0df0c93d0b 2023-02-11 09:55:42,344 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211d5c4568f80f64eeca3a511bbbade491d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230211d5c4568f80f64eeca3a511bbbade491d 2023-02-11 09:55:42,346 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302117571b47b6f6a41129ec778afc143c407 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302117571b47b6f6a41129ec778afc143c407 2023-02-11 09:55:42,359 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/fd07b35274d04d06a686803df8cf193d 2023-02-11 09:55:42,360 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/e03b1867822a4707ada4e07303c844b6 2023-02-11 09:55:42,364 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/f51b37195438463baf31597a9a6108e2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/f51b37195438463baf31597a9a6108e2 2023-02-11 09:55:42,364 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/e9a3cd5ff11740129a7192ade766f033 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e9a3cd5ff11740129a7192ade766f033 2023-02-11 09:55:42,367 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e9a3cd5ff11740129a7192ade766f033, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 09:55:42,367 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/f51b37195438463baf31597a9a6108e2, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 09:55:42,368 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/e03b1867822a4707ada4e07303c844b6 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/e03b1867822a4707ada4e07303c844b6 2023-02-11 09:55:42,368 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/fd07b35274d04d06a686803df8cf193d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/fd07b35274d04d06a686803df8cf193d 2023-02-11 09:55:42,372 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/fd07b35274d04d06a686803df8cf193d, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:55:42,372 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/e03b1867822a4707ada4e07303c844b6, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:55:42,373 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8ae1a139e38795e298a38629c4c20c98 in 870ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:42,373 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 468aeccb8d22c50304be9feb00b5922a in 871ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:42,373 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:42,373 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:42,373 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:42,373 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:42,373 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:42,373 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:42,760 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/f55866a13b984b9cbcac6ec0004c199b 2023-02-11 09:55:42,764 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/a09f4e7474674b2b9ec3f5bdf04a1df2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/a09f4e7474674b2b9ec3f5bdf04a1df2 2023-02-11 09:55:42,767 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/a09f4e7474674b2b9ec3f5bdf04a1df2, entries=4, sequenceid=9, filesize=5.4 K 2023-02-11 09:55:42,768 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/f55866a13b984b9cbcac6ec0004c199b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/f55866a13b984b9cbcac6ec0004c199b 2023-02-11 09:55:42,771 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/f55866a13b984b9cbcac6ec0004c199b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:55:42,771 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f2aa1f4e83b52c040476aa6bd5c21877 in 1268ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:42,771 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:42,771 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:42,771 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:42,772 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:42,772 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,772 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 09:55:42,772 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 09:55:42,774 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:42,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:42,774 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 09:55:42,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19690ed7[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:42,776 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 09:55:42,776 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,777 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,777 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 09:55:42,777 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 09:55:42,777 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:42,777 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,777 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:42,781 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,781 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 09:55:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:42,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:42,781 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:42,781 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 09:55:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:42,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:42,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:42,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 09:55:42,783 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 09:55:42,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:42,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:42,783 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 09:55:42,783 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:42,786 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,786 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:42,786 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,786 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:42,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:42,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:42,788 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:42,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:42,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:42,790 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:42,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 09:55:42,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:42,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:42,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:42,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:42,790 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:42,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:42,890 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:42,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:42,892 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:42,893 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:42,893 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:42,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:42,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:42,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 09:55:42,897 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 09:55:42,897 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:42,897 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 09:55:42,897 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 09:55:42,897 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,897 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:42,899 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:42,899 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:42,899 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:42,899 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:42,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:42,900 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 09:55:42,900 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 09:55:42,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 09:55:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 09:55:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 09:55:42,900 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:42,900 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. started... 2023-02-11 09:55:42,900 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:42,901 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. started... 2023-02-11 09:55:42,901 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 468aeccb8d22c50304be9feb00b5922a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:55:42,901 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ae1a139e38795e298a38629c4c20c98 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:55:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:42,903 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:42,903 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. started... 2023-02-11 09:55:42,903 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f2aa1f4e83b52c040476aa6bd5c21877 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:55:43,321 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211e3ad5d98f53348eaad1b71b485c40e49 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211e3ad5d98f53348eaad1b71b485c40e49 2023-02-11 09:55:43,321 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211cd43e253d2d44ed5905061004223ec03 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211cd43e253d2d44ed5905061004223ec03 2023-02-11 09:55:43,322 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021141f82d3c16824576bb1c090cf505cf73 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021141f82d3c16824576bb1c090cf505cf73 2023-02-11 09:55:43,731 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/6fafb064e482442c95ff106be7e3bbc5 2023-02-11 09:55:43,731 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/787c273c755b4c53968e9bc91836a39f 2023-02-11 09:55:43,731 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/6dbbbd0778ed45b2b93ea7751bb5a812 2023-02-11 09:55:43,743 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211eb85e74f72394ae58f371ae080b09e20 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230211eb85e74f72394ae58f371ae080b09e20 2023-02-11 09:55:44,144 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021129589ccafce649a29a0adde740e2b236 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021129589ccafce649a29a0adde740e2b236 2023-02-11 09:55:44,144 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211002ad26495be4db1a124c24ec2cda1d0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230211002ad26495be4db1a124c24ec2cda1d0 2023-02-11 09:55:44,147 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/c14a5bed4d2642a59c2d310afe23510e 2023-02-11 09:55:44,149 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/c404b085fc7643f6bbea5bd78756669f 2023-02-11 09:55:44,151 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/6fafb064e482442c95ff106be7e3bbc5 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/6fafb064e482442c95ff106be7e3bbc5 2023-02-11 09:55:44,154 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/6dbbbd0778ed45b2b93ea7751bb5a812 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/6dbbbd0778ed45b2b93ea7751bb5a812 2023-02-11 09:55:44,155 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/6fafb064e482442c95ff106be7e3bbc5, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 09:55:44,156 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/c14a5bed4d2642a59c2d310afe23510e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c14a5bed4d2642a59c2d310afe23510e 2023-02-11 09:55:44,158 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/6dbbbd0778ed45b2b93ea7751bb5a812, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 09:55:44,159 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/c404b085fc7643f6bbea5bd78756669f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/c404b085fc7643f6bbea5bd78756669f 2023-02-11 09:55:44,159 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c14a5bed4d2642a59c2d310afe23510e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:55:44,160 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 468aeccb8d22c50304be9feb00b5922a in 1259ms, sequenceid=13, compaction requested=true 2023-02-11 09:55:44,161 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:44,161 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:44,161 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:44,163 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/c404b085fc7643f6bbea5bd78756669f, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:55:44,164 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f2aa1f4e83b52c040476aa6bd5c21877 in 1261ms, sequenceid=13, compaction requested=true 2023-02-11 09:55:44,164 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:44,164 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:44,549 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/b7546eed6a9f43c58154f24b0c894b87 2023-02-11 09:55:44,553 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/787c273c755b4c53968e9bc91836a39f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/787c273c755b4c53968e9bc91836a39f 2023-02-11 09:55:44,556 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/787c273c755b4c53968e9bc91836a39f, entries=4, sequenceid=13, filesize=5.4 K 2023-02-11 09:55:44,557 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/b7546eed6a9f43c58154f24b0c894b87 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b7546eed6a9f43c58154f24b0c894b87 2023-02-11 09:55:44,560 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b7546eed6a9f43c58154f24b0c894b87, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:55:44,561 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8ae1a139e38795e298a38629c4c20c98 in 1660ms, sequenceid=13, compaction requested=true 2023-02-11 09:55:44,561 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:44,561 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:44,561 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:44,561 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:44,561 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,561 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 09:55:44,561 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 09:55:44,563 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,563 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:44,563 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,563 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:44,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:44,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:44,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 09:55:44,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39fca9e4[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:44,564 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 09:55:44,564 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,565 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 09:55:44,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 09:55:44,565 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:44,565 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,566 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:44,568 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,568 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 09:55:44,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:44,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:44,568 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:44,568 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 09:55:44,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:44,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 09:55:44,570 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 09:55:44,570 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:44,570 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:44,570 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 09:55:44,570 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:44,571 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,571 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:44,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,571 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:44,572 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:44,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:44,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:44,575 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,577 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:44,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 09:55:44,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:44,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:44,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:44,577 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:44,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:44,678 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:44,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:44,680 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:44,680 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:44,680 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:55:44,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:44,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:44,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 09:55:44,684 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 09:55:44,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:44,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 09:55:44,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 09:55:44,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,684 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:44,686 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,686 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:44,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:44,686 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:44,686 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:44,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:44,687 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 09:55:44,687 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 09:55:44,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 09:55:44,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 09:55:44,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:44,687 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 09:55:44,687 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:44,688 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. started... 2023-02-11 09:55:44,688 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:44,688 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. started... 2023-02-11 09:55:44,688 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 468aeccb8d22c50304be9feb00b5922a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:55:44,688 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:44,688 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. started... 2023-02-11 09:55:44,688 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f2aa1f4e83b52c040476aa6bd5c21877 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:55:44,688 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:44,688 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ae1a139e38795e298a38629c4c20c98 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:55:44,688 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:44,702 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ddd32fef3b6e4e59b4e74e59511c6c03 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211ddd32fef3b6e4e59b4e74e59511c6c03 2023-02-11 09:55:44,855 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:55:45,102 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211a5fd07e663894433a85c4ddba66081e1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211a5fd07e663894433a85c4ddba66081e1 2023-02-11 09:55:45,102 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302118d98a306ff5c437ba353038b2590ba0a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302118d98a306ff5c437ba353038b2590ba0a 2023-02-11 09:55:45,110 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/3fb8c90e6ba94a36bda92344ed387093 2023-02-11 09:55:45,506 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/a3cecb5e337f41bcaa178dddffa98eda 2023-02-11 09:55:45,506 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/e726d2c3a7b048949536580d3eff99e8 2023-02-11 09:55:45,527 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211a24217e493fe4d7fa5536c1112697803 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230211a24217e493fe4d7fa5536c1112697803 2023-02-11 09:55:45,534 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302113133f38accd143d1a56113a91a3a4294 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302113133f38accd143d1a56113a91a3a4294 2023-02-11 09:55:45,536 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211452e95423ba841c8aceb2a54733af9b9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230211452e95423ba841c8aceb2a54733af9b9 2023-02-11 09:55:45,545 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/c938b4ba5c90442988c898ef1dde3543 2023-02-11 09:55:45,546 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/b22cc46aa8a34428a2e89b2a84718db7 2023-02-11 09:55:45,550 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/e726d2c3a7b048949536580d3eff99e8 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e726d2c3a7b048949536580d3eff99e8 2023-02-11 09:55:45,550 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/a3cecb5e337f41bcaa178dddffa98eda as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/a3cecb5e337f41bcaa178dddffa98eda 2023-02-11 09:55:45,553 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e726d2c3a7b048949536580d3eff99e8, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 09:55:45,554 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/c938b4ba5c90442988c898ef1dde3543 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c938b4ba5c90442988c898ef1dde3543 2023-02-11 09:55:45,554 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/a3cecb5e337f41bcaa178dddffa98eda, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 09:55:45,555 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/b22cc46aa8a34428a2e89b2a84718db7 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b22cc46aa8a34428a2e89b2a84718db7 2023-02-11 09:55:45,558 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c938b4ba5c90442988c898ef1dde3543, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:55:45,558 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 468aeccb8d22c50304be9feb00b5922a in 870ms, sequenceid=17, compaction requested=true 2023-02-11 09:55:45,558 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:45,558 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:45,558 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:45,559 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b22cc46aa8a34428a2e89b2a84718db7, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:55:45,559 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8ae1a139e38795e298a38629c4c20c98 in 871ms, sequenceid=17, compaction requested=true 2023-02-11 09:55:45,559 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:45,559 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:45,559 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:45,938 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/26d462928c5a480ca6fc83afca01ef53 2023-02-11 09:55:45,944 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/3fb8c90e6ba94a36bda92344ed387093 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/3fb8c90e6ba94a36bda92344ed387093 2023-02-11 09:55:45,948 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/3fb8c90e6ba94a36bda92344ed387093, entries=4, sequenceid=17, filesize=5.4 K 2023-02-11 09:55:45,948 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/26d462928c5a480ca6fc83afca01ef53 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/26d462928c5a480ca6fc83afca01ef53 2023-02-11 09:55:45,953 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/26d462928c5a480ca6fc83afca01ef53, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:55:45,953 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f2aa1f4e83b52c040476aa6bd5c21877 in 1265ms, sequenceid=17, compaction requested=true 2023-02-11 09:55:45,954 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:45,954 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 09:55:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 09:55:45,955 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,955 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:45,956 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,956 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:45,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 09:55:45,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c61d64c[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:45,957 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 09:55:45,957 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,958 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 09:55:45,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 09:55:45,959 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,959 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:45,959 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:45,961 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,961 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 09:55:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:45,961 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:45,961 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 09:55:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:45,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 09:55:45,963 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 09:55:45,963 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:45,964 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:45,964 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 09:55:45,964 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:45,965 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:45,965 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:45,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:45,965 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:45,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:45,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:45,966 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:45,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:45,967 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:45,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:45,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:45,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:45,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:45,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:45,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:45,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 09:55:45,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:45,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:45,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 09:55:45,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:45,969 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:45,969 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,970 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:45,970 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:45,970 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:45,970 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:45,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:45,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:46,070 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:46,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:46,082 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:46,093 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:46,103 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:46,104 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:46,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:46,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:46,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-11 09:55:46,132 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-11 09:55:46,132 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:46,132 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-11 09:55:46,132 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-11 09:55:46,133 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:46,133 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:46,135 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:46,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:46,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:46,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:46,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:46,135 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:46,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:46,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:46,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:46,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:46,136 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-11 09:55:46,136 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-11 09:55:46,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-11 09:55:46,136 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-11 09:55:46,136 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:46,136 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-11 09:55:46,136 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:46,136 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:46,136 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:55:46,136 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:46,136 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. started... 2023-02-11 09:55:46,136 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:46,137 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. started... 2023-02-11 09:55:46,136 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. started... 2023-02-11 09:55:46,137 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f2aa1f4e83b52c040476aa6bd5c21877 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:55:46,137 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8ae1a139e38795e298a38629c4c20c98 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:55:46,137 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 468aeccb8d22c50304be9feb00b5922a 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:55:46,576 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/7552542204f84988866bdab6bedf0a1d 2023-02-11 09:55:46,580 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7552542204f84988866bdab6bedf0a1d 2023-02-11 09:55:46,589 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/452808f563bc49169d62768fcac105e4 2023-02-11 09:55:46,593 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 452808f563bc49169d62768fcac105e4 2023-02-11 09:55:46,982 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/09cb5793d7e6499091f39ee53f0efd3a 2023-02-11 09:55:46,985 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09cb5793d7e6499091f39ee53f0efd3a 2023-02-11 09:55:47,005 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/c36ac900d6314ec9825c0010e93333de 2023-02-11 09:55:47,009 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c36ac900d6314ec9825c0010e93333de 2023-02-11 09:55:47,010 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/452808f563bc49169d62768fcac105e4 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/452808f563bc49169d62768fcac105e4 2023-02-11 09:55:47,014 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 452808f563bc49169d62768fcac105e4 2023-02-11 09:55:47,014 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/452808f563bc49169d62768fcac105e4, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 09:55:47,014 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/c36ac900d6314ec9825c0010e93333de as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/c36ac900d6314ec9825c0010e93333de 2023-02-11 09:55:47,018 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c36ac900d6314ec9825c0010e93333de 2023-02-11 09:55:47,018 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/c36ac900d6314ec9825c0010e93333de, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 09:55:47,019 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8ae1a139e38795e298a38629c4c20c98 in 882ms, sequenceid=23, compaction requested=true 2023-02-11 09:55:47,019 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:47,019 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:47,019 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:55:47,396 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/e7a97cc685d74f56a7c7c64379677deb 2023-02-11 09:55:47,396 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/0434178c9d7b45edb30d6135e814f7e0 2023-02-11 09:55:47,399 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0434178c9d7b45edb30d6135e814f7e0 2023-02-11 09:55:47,399 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7a97cc685d74f56a7c7c64379677deb 2023-02-11 09:55:47,400 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/09cb5793d7e6499091f39ee53f0efd3a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/09cb5793d7e6499091f39ee53f0efd3a 2023-02-11 09:55:47,400 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/7552542204f84988866bdab6bedf0a1d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/7552542204f84988866bdab6bedf0a1d 2023-02-11 09:55:47,403 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09cb5793d7e6499091f39ee53f0efd3a 2023-02-11 09:55:47,403 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/09cb5793d7e6499091f39ee53f0efd3a, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 09:55:47,403 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7552542204f84988866bdab6bedf0a1d 2023-02-11 09:55:47,403 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/7552542204f84988866bdab6bedf0a1d, entries=3, sequenceid=23, filesize=5.0 K 2023-02-11 09:55:47,404 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/0434178c9d7b45edb30d6135e814f7e0 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/0434178c9d7b45edb30d6135e814f7e0 2023-02-11 09:55:47,404 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/e7a97cc685d74f56a7c7c64379677deb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/e7a97cc685d74f56a7c7c64379677deb 2023-02-11 09:55:47,408 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0434178c9d7b45edb30d6135e814f7e0 2023-02-11 09:55:47,408 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/0434178c9d7b45edb30d6135e814f7e0, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 09:55:47,408 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7a97cc685d74f56a7c7c64379677deb 2023-02-11 09:55:47,408 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/e7a97cc685d74f56a7c7c64379677deb, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 09:55:47,409 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 468aeccb8d22c50304be9feb00b5922a in 1272ms, sequenceid=23, compaction requested=true 2023-02-11 09:55:47,409 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:47,409 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:55:47,409 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f2aa1f4e83b52c040476aa6bd5c21877 in 1272ms, sequenceid=23, compaction requested=true 2023-02-11 09:55:47,409 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:47,409 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:55:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:55:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-11 09:55:47,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-11 09:55:47,412 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,412 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-11 09:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ebf3d6a[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:47,414 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-11 09:55:47,414 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,416 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,416 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-11 09:55:47,416 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-11 09:55:47,416 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,416 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:47,416 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-11 09:55:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:47,420 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,420 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-11 09:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:47,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:47,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-11 09:55:47,422 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-11 09:55:47,422 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:47,422 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:47,422 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-11 09:55:47,422 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:47,424 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:47,424 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:47,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:47,424 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:47,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:47,424 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:47,425 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-11 09:55:47,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,427 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,427 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:47,427 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:47,427 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-11 09:55:47,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:47,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-11 09:55:47,427 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:47,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:47,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-11 09:55:47,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:47,427 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:47,427 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:47,428 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,428 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-11 09:55:47,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:47,428 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-11 09:55:47,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:47,428 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:47,428 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:47,528 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:47,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:47,529 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:47,529 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 468aeccb8d22c50304be9feb00b5922a/family1 is initiating major compaction (all files) 2023-02-11 09:55:47,530 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:47,530 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:47,530 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 468aeccb8d22c50304be9feb00b5922a/family1 in ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:47,530 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/17be38c886024888b3462ccf73120604, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e9a3cd5ff11740129a7192ade766f033, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/6fafb064e482442c95ff106be7e3bbc5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e726d2c3a7b048949536580d3eff99e8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/09cb5793d7e6499091f39ee53f0efd3a] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp, totalSize=26.6 K 2023-02-11 09:55:47,530 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 17be38c886024888b3462ccf73120604, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109339709 2023-02-11 09:55:47,531 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting e9a3cd5ff11740129a7192ade766f033, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109341493 2023-02-11 09:55:47,531 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 6fafb064e482442c95ff106be7e3bbc5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109342893 2023-02-11 09:55:47,532 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting e726d2c3a7b048949536580d3eff99e8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109344680 2023-02-11 09:55:47,532 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 09cb5793d7e6499091f39ee53f0efd3a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:55:47,541 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 468aeccb8d22c50304be9feb00b5922a#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:47,950 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021159a8f3ed1af84a09ab3f0399a12dace3_del 2023-02-11 09:55:47,950 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021159a8f3ed1af84a09ab3f0399a12dace3_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021159a8f3ed1af84a09ab3f0399a12dace3_del 2023-02-11 09:55:48,763 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c45a0b5bab9a4c2c9df87edda07f1c57 2023-02-11 09:55:48,764 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family1/c45a0b5bab9a4c2c9df87edda07f1c57 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/c45a0b5bab9a4c2c9df87edda07f1c57 2023-02-11 09:55:48,768 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c45a0b5bab9a4c2c9df87edda07f1c57 2023-02-11 09:55:48,769 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 468aeccb8d22c50304be9feb00b5922a/family1 of 468aeccb8d22c50304be9feb00b5922a into c45a0b5bab9a4c2c9df87edda07f1c57(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:48,769 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:48,769 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:48,769 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 468aeccb8d22c50304be9feb00b5922a/family2 is initiating major compaction (all files) 2023-02-11 09:55:48,769 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:48,769 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:48,769 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 468aeccb8d22c50304be9feb00b5922a/family2 in ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:55:48,769 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/8c6e1427a22b406498b361de62853c1b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/e03b1867822a4707ada4e07303c844b6, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c14a5bed4d2642a59c2d310afe23510e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c938b4ba5c90442988c898ef1dde3543, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/0434178c9d7b45edb30d6135e814f7e0] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp, totalSize=25.3 K 2023-02-11 09:55:48,770 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 8c6e1427a22b406498b361de62853c1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109339709 2023-02-11 09:55:48,770 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting e03b1867822a4707ada4e07303c844b6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109341493 2023-02-11 09:55:48,771 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting c14a5bed4d2642a59c2d310afe23510e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109342893 2023-02-11 09:55:48,771 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting c938b4ba5c90442988c898ef1dde3543, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109344680 2023-02-11 09:55:48,771 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 0434178c9d7b45edb30d6135e814f7e0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:55:48,780 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 468aeccb8d22c50304be9feb00b5922a#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:48,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/17be38c886024888b3462ccf73120604, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e9a3cd5ff11740129a7192ade766f033, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/6fafb064e482442c95ff106be7e3bbc5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e726d2c3a7b048949536580d3eff99e8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/09cb5793d7e6499091f39ee53f0efd3a] to archive 2023-02-11 09:55:48,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:48,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/17be38c886024888b3462ccf73120604 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/17be38c886024888b3462ccf73120604 2023-02-11 09:55:48,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e9a3cd5ff11740129a7192ade766f033 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e9a3cd5ff11740129a7192ade766f033 2023-02-11 09:55:48,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/6fafb064e482442c95ff106be7e3bbc5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/6fafb064e482442c95ff106be7e3bbc5 2023-02-11 09:55:48,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e726d2c3a7b048949536580d3eff99e8 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/e726d2c3a7b048949536580d3eff99e8 2023-02-11 09:55:48,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/09cb5793d7e6499091f39ee53f0efd3a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/09cb5793d7e6499091f39ee53f0efd3a 2023-02-11 09:55:49,191 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302114d972be0b7ca448f821a4d27e2ad66a8_del 2023-02-11 09:55:49,191 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302114d972be0b7ca448f821a4d27e2ad66a8_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302114d972be0b7ca448f821a4d27e2ad66a8_del 2023-02-11 09:55:49,609 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0749c195f844481b5f68e9f118387cd 2023-02-11 09:55:49,609 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/.tmp/family2/b0749c195f844481b5f68e9f118387cd as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/b0749c195f844481b5f68e9f118387cd 2023-02-11 09:55:49,612 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b0749c195f844481b5f68e9f118387cd 2023-02-11 09:55:49,613 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 468aeccb8d22c50304be9feb00b5922a/family2 of 468aeccb8d22c50304be9feb00b5922a into b0749c195f844481b5f68e9f118387cd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:49,613 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:49,613 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:49,613 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 8ae1a139e38795e298a38629c4c20c98/family1 is initiating major compaction (all files) 2023-02-11 09:55:49,613 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:49,614 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:49,614 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 8ae1a139e38795e298a38629c4c20c98/family1 in ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:49,614 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/8e508e4f7fd14f64aff9f002c38337c4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/f51b37195438463baf31597a9a6108e2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/787c273c755b4c53968e9bc91836a39f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/a3cecb5e337f41bcaa178dddffa98eda, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/452808f563bc49169d62768fcac105e4] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp, totalSize=26.6 K 2023-02-11 09:55:49,615 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 8e508e4f7fd14f64aff9f002c38337c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109339708 2023-02-11 09:55:49,615 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting f51b37195438463baf31597a9a6108e2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109341493 2023-02-11 09:55:49,615 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 787c273c755b4c53968e9bc91836a39f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109342892 2023-02-11 09:55:49,616 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting a3cecb5e337f41bcaa178dddffa98eda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109344679 2023-02-11 09:55:49,616 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 452808f563bc49169d62768fcac105e4, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:55:49,623 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 8ae1a139e38795e298a38629c4c20c98#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:49,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/8c6e1427a22b406498b361de62853c1b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/e03b1867822a4707ada4e07303c844b6, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c14a5bed4d2642a59c2d310afe23510e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c938b4ba5c90442988c898ef1dde3543, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/0434178c9d7b45edb30d6135e814f7e0] to archive 2023-02-11 09:55:49,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:49,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/8c6e1427a22b406498b361de62853c1b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/8c6e1427a22b406498b361de62853c1b 2023-02-11 09:55:49,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/e03b1867822a4707ada4e07303c844b6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/e03b1867822a4707ada4e07303c844b6 2023-02-11 09:55:49,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c14a5bed4d2642a59c2d310afe23510e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c14a5bed4d2642a59c2d310afe23510e 2023-02-11 09:55:49,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c938b4ba5c90442988c898ef1dde3543 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/c938b4ba5c90442988c898ef1dde3543 2023-02-11 09:55:49,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/0434178c9d7b45edb30d6135e814f7e0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family2/0434178c9d7b45edb30d6135e814f7e0 2023-02-11 09:55:50,030 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211ea2f882361f34d4c9a8c26fefb72f707_del 2023-02-11 09:55:50,031 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211ea2f882361f34d4c9a8c26fefb72f707_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211ea2f882361f34d4c9a8c26fefb72f707_del 2023-02-11 09:55:50,063 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c372f5cd78d4475bffcb5bcbb35f2e2 2023-02-11 09:55:50,064 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family1/6c372f5cd78d4475bffcb5bcbb35f2e2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/6c372f5cd78d4475bffcb5bcbb35f2e2 2023-02-11 09:55:50,069 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c372f5cd78d4475bffcb5bcbb35f2e2 2023-02-11 09:55:50,070 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8ae1a139e38795e298a38629c4c20c98/family1 of 8ae1a139e38795e298a38629c4c20c98 into 6c372f5cd78d4475bffcb5bcbb35f2e2(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:50,071 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:50,071 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:50,071 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 8ae1a139e38795e298a38629c4c20c98/family2 is initiating major compaction (all files) 2023-02-11 09:55:50,071 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:50,071 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:50,071 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 8ae1a139e38795e298a38629c4c20c98/family2 in ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:55:50,071 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/0707fd879f034228885add85b06acbb6, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/fd07b35274d04d06a686803df8cf193d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b7546eed6a9f43c58154f24b0c894b87, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b22cc46aa8a34428a2e89b2a84718db7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/c36ac900d6314ec9825c0010e93333de] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp, totalSize=25.3 K 2023-02-11 09:55:50,071 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 0707fd879f034228885add85b06acbb6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109339708 2023-02-11 09:55:50,072 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting fd07b35274d04d06a686803df8cf193d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109341493 2023-02-11 09:55:50,073 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting b7546eed6a9f43c58154f24b0c894b87, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109342892 2023-02-11 09:55:50,074 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting b22cc46aa8a34428a2e89b2a84718db7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109344679 2023-02-11 09:55:50,074 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting c36ac900d6314ec9825c0010e93333de, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:55:50,087 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 8ae1a139e38795e298a38629c4c20c98#family2#compaction#153 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:50,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/8e508e4f7fd14f64aff9f002c38337c4, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/f51b37195438463baf31597a9a6108e2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/787c273c755b4c53968e9bc91836a39f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/a3cecb5e337f41bcaa178dddffa98eda, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/452808f563bc49169d62768fcac105e4] to archive 2023-02-11 09:55:50,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:50,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/8e508e4f7fd14f64aff9f002c38337c4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/8e508e4f7fd14f64aff9f002c38337c4 2023-02-11 09:55:50,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/f51b37195438463baf31597a9a6108e2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/f51b37195438463baf31597a9a6108e2 2023-02-11 09:55:50,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/787c273c755b4c53968e9bc91836a39f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/787c273c755b4c53968e9bc91836a39f 2023-02-11 09:55:50,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/a3cecb5e337f41bcaa178dddffa98eda to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/a3cecb5e337f41bcaa178dddffa98eda 2023-02-11 09:55:50,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/452808f563bc49169d62768fcac105e4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/452808f563bc49169d62768fcac105e4 2023-02-11 09:55:50,495 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021132938d49344240eb89cfee98352515f8_del 2023-02-11 09:55:50,495 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021132938d49344240eb89cfee98352515f8_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021132938d49344240eb89cfee98352515f8_del 2023-02-11 09:55:50,909 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9576a0e3cb7344c5b5bc6ec51b23a449 2023-02-11 09:55:50,910 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/.tmp/family2/9576a0e3cb7344c5b5bc6ec51b23a449 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/9576a0e3cb7344c5b5bc6ec51b23a449 2023-02-11 09:55:50,920 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9576a0e3cb7344c5b5bc6ec51b23a449 2023-02-11 09:55:50,921 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8ae1a139e38795e298a38629c4c20c98/family2 of 8ae1a139e38795e298a38629c4c20c98 into 9576a0e3cb7344c5b5bc6ec51b23a449(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:50,921 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:50,921 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:50,921 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): f2aa1f4e83b52c040476aa6bd5c21877/family1 is initiating major compaction (all files) 2023-02-11 09:55:50,921 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:50,921 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:50,921 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of f2aa1f4e83b52c040476aa6bd5c21877/family1 in ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:50,921 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/1d79fa818b33437e8c258cdf6962f601, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/a09f4e7474674b2b9ec3f5bdf04a1df2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/6dbbbd0778ed45b2b93ea7751bb5a812, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/3fb8c90e6ba94a36bda92344ed387093, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/7552542204f84988866bdab6bedf0a1d] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp, totalSize=26.6 K 2023-02-11 09:55:50,922 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 1d79fa818b33437e8c258cdf6962f601, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109339709 2023-02-11 09:55:50,922 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting a09f4e7474674b2b9ec3f5bdf04a1df2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109341493 2023-02-11 09:55:50,922 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 6dbbbd0778ed45b2b93ea7751bb5a812, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109342893 2023-02-11 09:55:50,923 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 3fb8c90e6ba94a36bda92344ed387093, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109344680 2023-02-11 09:55:50,923 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 7552542204f84988866bdab6bedf0a1d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:55:50,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/0707fd879f034228885add85b06acbb6, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/fd07b35274d04d06a686803df8cf193d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b7546eed6a9f43c58154f24b0c894b87, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b22cc46aa8a34428a2e89b2a84718db7, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/c36ac900d6314ec9825c0010e93333de] to archive 2023-02-11 09:55:50,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:50,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/0707fd879f034228885add85b06acbb6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/0707fd879f034228885add85b06acbb6 2023-02-11 09:55:50,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/fd07b35274d04d06a686803df8cf193d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/fd07b35274d04d06a686803df8cf193d 2023-02-11 09:55:50,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b7546eed6a9f43c58154f24b0c894b87 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b7546eed6a9f43c58154f24b0c894b87 2023-02-11 09:55:50,936 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): f2aa1f4e83b52c040476aa6bd5c21877#family1#compaction#154 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:50,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b22cc46aa8a34428a2e89b2a84718db7 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/b22cc46aa8a34428a2e89b2a84718db7 2023-02-11 09:55:50,942 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/c36ac900d6314ec9825c0010e93333de to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family2/c36ac900d6314ec9825c0010e93333de 2023-02-11 09:55:50,949 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302110f729b463b5146e3933061464c8be267_del 2023-02-11 09:55:50,949 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302110f729b463b5146e3933061464c8be267_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302110f729b463b5146e3933061464c8be267_del 2023-02-11 09:55:51,372 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59405408fc324c56b00f436d49da4278 2023-02-11 09:55:51,373 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family1/59405408fc324c56b00f436d49da4278 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/59405408fc324c56b00f436d49da4278 2023-02-11 09:55:51,377 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59405408fc324c56b00f436d49da4278 2023-02-11 09:55:51,378 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f2aa1f4e83b52c040476aa6bd5c21877/family1 of f2aa1f4e83b52c040476aa6bd5c21877 into 59405408fc324c56b00f436d49da4278(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:55:51,378 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:51,378 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:55:51,379 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): f2aa1f4e83b52c040476aa6bd5c21877/family2 is initiating major compaction (all files) 2023-02-11 09:55:51,379 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:55:51,379 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:55:51,380 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of f2aa1f4e83b52c040476aa6bd5c21877/family2 in ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:55:51,380 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/9c1b4048492040e08e116b85402efd8e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/f55866a13b984b9cbcac6ec0004c199b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/c404b085fc7643f6bbea5bd78756669f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/26d462928c5a480ca6fc83afca01ef53, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/e7a97cc685d74f56a7c7c64379677deb] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp, totalSize=25.3 K 2023-02-11 09:55:51,381 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 9c1b4048492040e08e116b85402efd8e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109339709 2023-02-11 09:55:51,381 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting f55866a13b984b9cbcac6ec0004c199b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109341493 2023-02-11 09:55:51,382 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting c404b085fc7643f6bbea5bd78756669f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109342893 2023-02-11 09:55:51,382 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 26d462928c5a480ca6fc83afca01ef53, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109344680 2023-02-11 09:55:51,382 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting e7a97cc685d74f56a7c7c64379677deb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:55:51,391 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): f2aa1f4e83b52c040476aa6bd5c21877#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:55:51,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/1d79fa818b33437e8c258cdf6962f601, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/a09f4e7474674b2b9ec3f5bdf04a1df2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/6dbbbd0778ed45b2b93ea7751bb5a812, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/3fb8c90e6ba94a36bda92344ed387093, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/7552542204f84988866bdab6bedf0a1d] to archive 2023-02-11 09:55:51,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:51,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/1d79fa818b33437e8c258cdf6962f601 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/1d79fa818b33437e8c258cdf6962f601 2023-02-11 09:55:51,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/a09f4e7474674b2b9ec3f5bdf04a1df2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/a09f4e7474674b2b9ec3f5bdf04a1df2 2023-02-11 09:55:51,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/6dbbbd0778ed45b2b93ea7751bb5a812 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/6dbbbd0778ed45b2b93ea7751bb5a812 2023-02-11 09:55:51,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/3fb8c90e6ba94a36bda92344ed387093 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/3fb8c90e6ba94a36bda92344ed387093 2023-02-11 09:55:51,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/7552542204f84988866bdab6bedf0a1d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/7552542204f84988866bdab6bedf0a1d 2023-02-11 09:55:51,799 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302114e63819cbbd74e4da503384c32d7af96_del 2023-02-11 09:55:51,799 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302114e63819cbbd74e4da503384c32d7af96_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302114e63819cbbd74e4da503384c32d7af96_del 2023-02-11 09:55:52,613 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e425d0acdf56441da576a682632dd99e 2023-02-11 09:55:52,614 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/.tmp/family2/e425d0acdf56441da576a682632dd99e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/e425d0acdf56441da576a682632dd99e 2023-02-11 09:55:52,618 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e425d0acdf56441da576a682632dd99e 2023-02-11 09:55:52,619 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f2aa1f4e83b52c040476aa6bd5c21877/family2 of f2aa1f4e83b52c040476aa6bd5c21877 into e425d0acdf56441da576a682632dd99e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:55:52,620 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:52,623 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:52,626 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:52,630 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:52,630 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:52,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/9c1b4048492040e08e116b85402efd8e, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/f55866a13b984b9cbcac6ec0004c199b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/c404b085fc7643f6bbea5bd78756669f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/26d462928c5a480ca6fc83afca01ef53, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/e7a97cc685d74f56a7c7c64379677deb] to archive 2023-02-11 09:55:52,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:52,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/9c1b4048492040e08e116b85402efd8e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/9c1b4048492040e08e116b85402efd8e 2023-02-11 09:55:52,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/f55866a13b984b9cbcac6ec0004c199b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/f55866a13b984b9cbcac6ec0004c199b 2023-02-11 09:55:52,641 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 09:55:52,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/c404b085fc7643f6bbea5bd78756669f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/c404b085fc7643f6bbea5bd78756669f 2023-02-11 09:55:52,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/26d462928c5a480ca6fc83afca01ef53 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/26d462928c5a480ca6fc83afca01ef53 2023-02-11 09:55:52,645 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/e7a97cc685d74f56a7c7c64379677deb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family2/e7a97cc685d74f56a7c7c64379677deb 2023-02-11 09:55:52,655 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-11 09:55:52,658 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211ea2f882361f34d4c9a8c26fefb72f707_del 2023-02-11 09:55:52,661 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021159a8f3ed1af84a09ab3f0399a12dace3_del 2023-02-11 09:55:52,663 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302110f729b463b5146e3933061464c8be267_del 2023-02-11 09:55:52,663 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:52,664 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(139): Connect 0x2c3f2136 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:55:52,668 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3215ecc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:55:52,669 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 09:55:52,669 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 09:55:52,669 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 09:55:53,090 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302119790ac4712b04336bc53c8a226b8ca59 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302119790ac4712b04336bc53c8a226b8ca59 2023-02-11 09:55:53,091 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021134d4779f56c34a669aa67cc9f8427143 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021134d4779f56c34a669aa67cc9f8427143 2023-02-11 09:55:53,092 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:53,092 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:53,106 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:55:53,110 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54170, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:55:53,123 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:55:53,132 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37536, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:55:53,144 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/3f5e71dfab56487e908709505d8cca67 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-11 09:55:53,144 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/013ebf55404d47a98f0c716511843070 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-11 09:55:53,145 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/3f5e71dfab56487e908709505d8cca67}] 2023-02-11 09:55:53,145 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/013ebf55404d47a98f0c716511843070}] 2023-02-11 09:55:53,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/3f5e71dfab56487e908709505d8cca67 for inclusion in 8ae1a139e38795e298a38629c4c20c98/family1 2023-02-11 09:55:53,153 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/013ebf55404d47a98f0c716511843070 for inclusion in f2aa1f4e83b52c040476aa6bd5c21877/family1 2023-02-11 09:55:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-11 09:55:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-11 09:55:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 09:55:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 09:55:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 8ae1a139e38795e298a38629c4c20c98: 2023-02-11 09:55:53,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for f2aa1f4e83b52c040476aa6bd5c21877: 2023-02-11 09:55:53,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211/family1/3f5e71dfab56487e908709505d8cca67 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__os5s2t1ikf551eipjesf3ekmpntd1k1vg82nr74frugp4r3s4s2flpvf6352m3m6/family1/3f5e71dfab56487e908709505d8cca67 2023-02-11 09:55:53,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211/family1/013ebf55404d47a98f0c716511843070 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__oqpo1fgk902q91gsit8ie3k9fm2etqidqchblcmf565lj1amsncl0qt7terbniiv/family1/013ebf55404d47a98f0c716511843070 2023-02-11 09:55:53,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__oqpo1fgk902q91gsit8ie3k9fm2etqidqchblcmf565lj1amsncl0qt7terbniiv/family1/013ebf55404d47a98f0c716511843070 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/415b5f47973c4240a21df24433b9356f_SeqId_28_ 2023-02-11 09:55:53,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__os5s2t1ikf551eipjesf3ekmpntd1k1vg82nr74frugp4r3s4s2flpvf6352m3m6/family1/3f5e71dfab56487e908709505d8cca67 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/d45842b54d8946419fc60694cd2a90b2_SeqId_28_ 2023-02-11 09:55:53,159 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__oqpo1fgk902q91gsit8ie3k9fm2etqidqchblcmf565lj1amsncl0qt7terbniiv/family1/013ebf55404d47a98f0c716511843070 into f2aa1f4e83b52c040476aa6bd5c21877/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/415b5f47973c4240a21df24433b9356f_SeqId_28_ - updating store file list. 2023-02-11 09:55:53,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__os5s2t1ikf551eipjesf3ekmpntd1k1vg82nr74frugp4r3s4s2flpvf6352m3m6/family1/3f5e71dfab56487e908709505d8cca67 into 8ae1a139e38795e298a38629c4c20c98/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/d45842b54d8946419fc60694cd2a90b2_SeqId_28_ - updating store file list. 2023-02-11 09:55:53,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/d45842b54d8946419fc60694cd2a90b2_SeqId_28_ into 8ae1a139e38795e298a38629c4c20c98/family1 2023-02-11 09:55:53,163 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/415b5f47973c4240a21df24433b9356f_SeqId_28_ into f2aa1f4e83b52c040476aa6bd5c21877/family1 2023-02-11 09:55:53,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__os5s2t1ikf551eipjesf3ekmpntd1k1vg82nr74frugp4r3s4s2flpvf6352m3m6/family1/3f5e71dfab56487e908709505d8cca67 into 8ae1a139e38795e298a38629c4c20c98/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/family1/d45842b54d8946419fc60694cd2a90b2_SeqId_28_) 2023-02-11 09:55:53,163 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__oqpo1fgk902q91gsit8ie3k9fm2etqidqchblcmf565lj1amsncl0qt7terbniiv/family1/013ebf55404d47a98f0c716511843070 into f2aa1f4e83b52c040476aa6bd5c21877/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/family1/415b5f47973c4240a21df24433b9356f_SeqId_28_) 2023-02-11 09:55:53,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__oqpo1fgk902q91gsit8ie3k9fm2etqidqchblcmf565lj1amsncl0qt7terbniiv/family1/013ebf55404d47a98f0c716511843070 2023-02-11 09:55:53,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__os5s2t1ikf551eipjesf3ekmpntd1k1vg82nr74frugp4r3s4s2flpvf6352m3m6/family1/3f5e71dfab56487e908709505d8cca67 2023-02-11 09:55:53,165 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:53,165 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:53,166 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:53,166 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:53,167 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211e40970c43a9642858dca46e8bde5889e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230211e40970c43a9642858dca46e8bde5889e 2023-02-11 09:55:53,167 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211e94a40d90f944c0e92ae90deacb3cea6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230211e94a40d90f944c0e92ae90deacb3cea6 2023-02-11 09:55:53,167 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 09:55:53,167 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 09:55:53,167 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 09:55:53,167 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 09:55:53,167 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 09:55:53,168 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 09:55:53,491 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302115ed5473d8f5f466bb9b6e648dea98500 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302115ed5473d8f5f466bb9b6e648dea98500 2023-02-11 09:55:53,492 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:53,514 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/4acb344c8a5c4218ac448f8472fb1978 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-11 09:55:53,515 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/4acb344c8a5c4218ac448f8472fb1978}] 2023-02-11 09:55:53,517 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/4acb344c8a5c4218ac448f8472fb1978 for inclusion in 468aeccb8d22c50304be9feb00b5922a/family1 2023-02-11 09:55:53,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-11 09:55:53,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 09:55:53,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 468aeccb8d22c50304be9feb00b5922a: 2023-02-11 09:55:53,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211/family1/4acb344c8a5c4218ac448f8472fb1978 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__7h334u12b7tsc7mvsktjaht0hu10e9l78ddg3pkeqc0gvlik29k3b6fmt3gsscte/family1/4acb344c8a5c4218ac448f8472fb1978 2023-02-11 09:55:53,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__7h334u12b7tsc7mvsktjaht0hu10e9l78ddg3pkeqc0gvlik29k3b6fmt3gsscte/family1/4acb344c8a5c4218ac448f8472fb1978 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/4b04b2bd26e94bb799be525d377b89d9_SeqId_28_ 2023-02-11 09:55:53,522 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__7h334u12b7tsc7mvsktjaht0hu10e9l78ddg3pkeqc0gvlik29k3b6fmt3gsscte/family1/4acb344c8a5c4218ac448f8472fb1978 into 468aeccb8d22c50304be9feb00b5922a/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/4b04b2bd26e94bb799be525d377b89d9_SeqId_28_ - updating store file list. 2023-02-11 09:55:53,524 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/4b04b2bd26e94bb799be525d377b89d9_SeqId_28_ into 468aeccb8d22c50304be9feb00b5922a/family1 2023-02-11 09:55:53,524 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__7h334u12b7tsc7mvsktjaht0hu10e9l78ddg3pkeqc0gvlik29k3b6fmt3gsscte/family1/4acb344c8a5c4218ac448f8472fb1978 into 468aeccb8d22c50304be9feb00b5922a/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/family1/4b04b2bd26e94bb799be525d377b89d9_SeqId_28_) 2023-02-11 09:55:53,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__ns_testMinorCompaction__7h334u12b7tsc7mvsktjaht0hu10e9l78ddg3pkeqc0gvlik29k3b6fmt3gsscte/family1/4acb344c8a5c4218ac448f8472fb1978 2023-02-11 09:55:53,526 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:53,527 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:55:53,528 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211b9372eca7cd24008b45d8fb9df56eff6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230211b9372eca7cd24008b45d8fb9df56eff6 2023-02-11 09:55:53,528 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-11 09:55:53,528 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 09:55:53,528 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='ns:testMinorCompaction' and column='family1' 2023-02-11 09:55:53,528 INFO [Listener at localhost/44465] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-11 09:55:53,530 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:53,532 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:53,534 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:55:53,535 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:55:53,551 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=252 (was 288), OpenFileDescriptor=634 (was 764), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=103 (was 105), ProcessCount=178 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3306 (was 2521) - AvailableMemoryMB LEAK? - 2023-02-11 09:55:53,565 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=103, ProcessCount=178, AvailableMemoryMB=3304 2023-02-11 09:55:53,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-11 09:55:53,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:53,569 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:55:53,569 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-11 09:55:53,570 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:55:53,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 09:55:53,571 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:53,571 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c empty. 2023-02-11 09:55:53,571 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:53,572 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-11 09:55:53,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 09:55:53,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 09:55:53,979 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-11 09:55:53,980 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => e39c80b296834ae566568212c2e2862c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:55:54,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 09:55:54,386 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:54,386 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing e39c80b296834ae566568212c2e2862c, disabling compactions & flushes 2023-02-11 09:55:54,386 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:54,386 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:54,386 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. after waiting 0 ms 2023-02-11 09:55:54,386 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:54,387 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:54,387 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for e39c80b296834ae566568212c2e2862c: Waiting for close lock at 1676109354386Disabling compacts and flushes for region at 1676109354386Disabling writes for close at 1676109354386Writing region close event to WAL at 1676109354387 (+1 ms)Closed at 1676109354387 2023-02-11 09:55:54,389 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:55:54,390 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676109354390"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109354390"}]},"ts":"1676109354390"} 2023-02-11 09:55:54,391 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 09:55:54,392 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:55:54,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109354392"}]},"ts":"1676109354392"} 2023-02-11 09:55:54,393 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-11 09:55:54,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e39c80b296834ae566568212c2e2862c, ASSIGN}] 2023-02-11 09:55:54,397 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e39c80b296834ae566568212c2e2862c, ASSIGN 2023-02-11 09:55:54,398 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e39c80b296834ae566568212c2e2862c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:55:54,549 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=e39c80b296834ae566568212c2e2862c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:54,549 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676109354549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109354549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109354549"}]},"ts":"1676109354549"} 2023-02-11 09:55:54,551 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure e39c80b296834ae566568212c2e2862c, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:55:54,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 09:55:54,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:54,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e39c80b296834ae566568212c2e2862c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c.', STARTKEY => '', ENDKEY => ''} 2023-02-11 09:55:54,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:54,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:55:54,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:54,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:54,707 INFO [StoreOpener-e39c80b296834ae566568212c2e2862c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:54,709 DEBUG [StoreOpener-e39c80b296834ae566568212c2e2862c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:55:54,709 DEBUG [StoreOpener-e39c80b296834ae566568212c2e2862c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:55:54,709 INFO [StoreOpener-e39c80b296834ae566568212c2e2862c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e39c80b296834ae566568212c2e2862c columnFamilyName family1 2023-02-11 09:55:54,716 INFO [StoreOpener-e39c80b296834ae566568212c2e2862c-1] regionserver.HStore(310): Store=e39c80b296834ae566568212c2e2862c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:55:54,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:54,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:54,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e39c80b296834ae566568212c2e2862c 2023-02-11 09:55:54,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:55:54,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e39c80b296834ae566568212c2e2862c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71505355, jitterRate=0.06551282107830048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 09:55:54,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e39c80b296834ae566568212c2e2862c: Running coprocessor pre-open hook at 1676109354706Writing region info on filesystem at 1676109354706Initializing all the Stores at 1676109354707 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676109354707Cleaning up temporary data from old regions at 1676109354718 (+11 ms)Cleaning up detritus from prior splits at 1676109354718Running coprocessor post-open hooks at 1676109354723 (+5 ms)Region opened successfully at 1676109354723 2023-02-11 09:55:54,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c., pid=114, masterSystemTime=1676109354702 2023-02-11 09:55:54,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:54,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:54,726 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=e39c80b296834ae566568212c2e2862c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:54,726 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676109354726"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109354726"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109354726"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109354726"}]},"ts":"1676109354726"} 2023-02-11 09:55:54,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-11 09:55:54,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure e39c80b296834ae566568212c2e2862c, server=jenkins-hbase4.apache.org,43463,1676109215499 in 176 msec 2023-02-11 09:55:54,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-11 09:55:54,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=e39c80b296834ae566568212c2e2862c, ASSIGN in 333 msec 2023-02-11 09:55:54,731 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:55:54,731 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109354731"}]},"ts":"1676109354731"} 2023-02-11 09:55:54,732 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-11 09:55:54,735 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:55:54,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1680 sec 2023-02-11 09:55:55,026 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:55,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-11 09:55:55,675 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-11 09:55:55,700 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:55,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,701 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:55,701 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:55,701 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:55:55,701 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:55:55,702 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,702 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,704 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:55,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:55,704 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,704 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:55,705 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:55,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:55,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,705 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:55,705 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:55:55,706 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:55,706 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:55:55,706 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:55:55,706 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:55,706 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:55,706 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:55:55,707 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-11 09:55:56,137 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130547a396e206642d6a4b5b540156dca01 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130547a396e206642d6a4b5b540156dca01 2023-02-11 09:55:56,540 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/bb3b2ba0b459459d9eab6ab3c564fdbb 2023-02-11 09:55:56,544 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/bb3b2ba0b459459d9eab6ab3c564fdbb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/bb3b2ba0b459459d9eab6ab3c564fdbb 2023-02-11 09:55:56,548 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/bb3b2ba0b459459d9eab6ab3c564fdbb, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-11 09:55:56,548 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 841ms, sequenceid=5, compaction requested=false 2023-02-11 09:55:56,549 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:55:56,549 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:55:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:55:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:55:56,549 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:55:56,551 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,551 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:56,551 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,551 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:56,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:55:56,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ff181dc[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:56,553 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:55:56,553 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,554 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:55:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:55:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:56,554 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,554 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:55:56,555 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:55:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:56,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:55:56,558 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:55:56,558 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:56,558 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:56,558 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,558 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:56,561 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,561 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:56,561 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:56,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:56,562 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,563 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,567 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:55:56,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:56,567 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:56,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:56,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:56,567 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:56,667 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:56,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:56,672 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:56,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:56,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,674 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:56,674 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:56,674 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:55:56,674 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:55:56,674 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,675 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,676 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,676 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:56,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:56,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:56,676 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:56,676 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:56,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:56,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,677 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,677 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:55:56,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:56,677 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:55:56,677 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:56,677 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:55:56,678 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:55:56,678 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:56,678 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:56,678 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:55:56,678 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-11 09:55:57,093 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288bd652e4d7c14a289b0af9bb739efd89 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288bd652e4d7c14a289b0af9bb739efd89 2023-02-11 09:55:57,498 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/19e9c050a902473aa6d969a0f969e209 2023-02-11 09:55:57,502 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/19e9c050a902473aa6d969a0f969e209 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/19e9c050a902473aa6d969a0f969e209 2023-02-11 09:55:57,505 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/19e9c050a902473aa6d969a0f969e209, entries=1, sequenceid=9, filesize=5.0 K 2023-02-11 09:55:57,505 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 827ms, sequenceid=9, compaction requested=false 2023-02-11 09:55:57,506 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:55:57,506 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:57,506 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:55:57,506 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:55:57,506 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,506 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:55:57,506 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:55:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,507 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:57,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,507 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:57,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:57,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:57,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:57,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:55:57,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@239ea44f[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:57,509 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:55:57,509 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,512 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:55:57,512 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,512 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:55:57,512 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:57,513 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:55:57,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:57,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:57,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:57,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:55:57,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:57,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:55:57,515 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:55:57,515 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:57,515 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:57,515 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,515 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:57,516 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,516 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:57,516 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:57,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:57,517 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,518 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:57,520 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:57,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:55:57,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:57,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:57,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:57,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:57,520 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:57,621 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:57,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:57,625 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:57,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:57,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,626 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:57,626 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:57,626 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:55:57,626 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:55:57,627 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,627 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,633 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:57,633 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:57,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:57,633 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:57,634 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,634 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,634 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:55:57,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:57,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:55:57,634 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:57,635 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:55:57,635 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:55:57,635 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:57,635 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:57,635 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:55:57,635 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:55:58,045 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013f4790c2934f420392f58c960d52153e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013f4790c2934f420392f58c960d52153e 2023-02-11 09:55:58,450 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/c1ab85af6b2c4c74838016b2afa5e0fb 2023-02-11 09:55:58,454 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/c1ab85af6b2c4c74838016b2afa5e0fb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c1ab85af6b2c4c74838016b2afa5e0fb 2023-02-11 09:55:58,457 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c1ab85af6b2c4c74838016b2afa5e0fb, entries=1, sequenceid=13, filesize=4.9 K 2023-02-11 09:55:58,458 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 823ms, sequenceid=13, compaction requested=true 2023-02-11 09:55:58,458 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:55:58,458 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:55:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:55:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:55:58,458 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:55:58,460 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,460 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:58,460 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,460 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:58,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:58,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:58,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:55:58,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1efc5c6[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:58,461 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:55:58,462 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,462 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:55:58,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:55:58,463 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:58,463 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,463 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:58,464 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:55:58,464 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,464 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:58,464 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:55:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:58,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:58,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:55:58,466 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:55:58,466 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:58,466 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:58,466 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,466 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:58,469 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,469 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:58,469 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:58,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:58,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:58,469 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,470 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,472 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,472 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:58,472 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:58,472 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:58,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:55:58,472 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,472 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:58,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:58,472 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:58,473 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:58,472 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,473 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:58,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:58,473 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,473 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,473 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,573 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:58,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:58,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,579 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:58,579 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:58,579 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:55:58,579 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:55:58,579 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,579 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,581 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,581 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:58,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:58,581 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:58,581 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,582 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,582 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:55:58,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:55:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:55:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:55:58,582 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:58,582 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:58,582 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:55:58,582 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:55:58,995 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056ab664fa96c241b4bb4322668919be3c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512056ab664fa96c241b4bb4322668919be3c 2023-02-11 09:55:59,400 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/c6e9bb250cec46eeba47b9abbae1eda8 2023-02-11 09:55:59,404 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/c6e9bb250cec46eeba47b9abbae1eda8 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c6e9bb250cec46eeba47b9abbae1eda8 2023-02-11 09:55:59,406 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c6e9bb250cec46eeba47b9abbae1eda8, entries=1, sequenceid=17, filesize=4.9 K 2023-02-11 09:55:59,407 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 825ms, sequenceid=17, compaction requested=true 2023-02-11 09:55:59,407 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:55:59,407 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:59,407 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:55:59,407 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:55:59,407 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:55:59,408 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:55:59,409 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,409 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:59,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:59,410 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,410 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:59,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:55:59,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56ececfc[Count = 0] remaining members to acquire global barrier 2023-02-11 09:55:59,411 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:55:59,411 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,413 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:55:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:55:59,413 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:55:59,413 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,413 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:55:59,414 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:55:59,414 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:59,414 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,414 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:55:59,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:55:59,417 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:55:59,417 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:55:59,417 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:55:59,417 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,417 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:55:59,418 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,418 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:55:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:55:59,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,418 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:55:59,419 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:55:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,420 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:55:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:59,422 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,422 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:59,422 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:55:59,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:55:59,422 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:55:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:55:59,522 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:55:59,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:55:59,526 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:55:59,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:55:59,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,528 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:55:59,528 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:59,528 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:55:59,528 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:55:59,528 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,528 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,530 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,530 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:55:59,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:55:59,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:55:59,531 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:55:59,531 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:55:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:55:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,531 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,531 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:55:59,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:55:59,532 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:55:59,532 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:55:59,532 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:55:59,532 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:55:59,532 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:55:59,532 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:55:59,532 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:55:59,532 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:55:59,944 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122807fbbdf3b07443fbadafc606c60601b9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122807fbbdf3b07443fbadafc606c60601b9 2023-02-11 09:56:00,242 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:56:00,350 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/2b25a9e72d2d4413b84d9c44dfcc2748 2023-02-11 09:56:00,353 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/2b25a9e72d2d4413b84d9c44dfcc2748 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/2b25a9e72d2d4413b84d9c44dfcc2748 2023-02-11 09:56:00,356 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/2b25a9e72d2d4413b84d9c44dfcc2748, entries=1, sequenceid=21, filesize=4.9 K 2023-02-11 09:56:00,357 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 825ms, sequenceid=21, compaction requested=true 2023-02-11 09:56:00,357 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:00,357 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:56:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:56:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:56:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:56:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,359 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,359 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:00,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:56:00,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2560689c[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:00,360 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:56:00,360 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,362 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,362 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:56:00,362 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:56:00,362 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,362 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:00,362 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:00,363 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:56:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:00,363 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:56:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:00,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:56:00,365 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:56:00,365 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:00,365 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:00,365 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,365 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:00,368 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,368 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:00,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,368 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:00,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:00,368 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,369 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:00,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,373 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:00,373 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:00,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:00,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:00,373 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,373 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:00,373 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,373 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:00,374 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:00,374 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:00,374 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:00,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:00,374 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,374 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,374 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,474 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:00,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:00,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:00,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:00,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,479 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:00,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:00,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:56:00,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:56:00,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,480 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,481 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,481 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:00,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:00,481 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:00,481 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:00,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,482 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,482 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:56:00,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:00,482 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:56:00,482 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:00,482 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:56:00,483 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:56:00,483 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:00,483 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:00,483 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:56:00,483 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:56:00,895 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231da86b4c6656643dabd14ae52aaa9c5e6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231da86b4c6656643dabd14ae52aaa9c5e6 2023-02-11 09:56:01,299 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/0168e8a7648b415388c1560f10c41b70 2023-02-11 09:56:01,303 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/0168e8a7648b415388c1560f10c41b70 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/0168e8a7648b415388c1560f10c41b70 2023-02-11 09:56:01,306 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/0168e8a7648b415388c1560f10c41b70, entries=1, sequenceid=25, filesize=4.9 K 2023-02-11 09:56:01,307 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 824ms, sequenceid=25, compaction requested=true 2023-02-11 09:56:01,307 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:01,307 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:56:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:56:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:56:01,307 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:56:01,308 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,308 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:01,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:01,309 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,309 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:01,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:01,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:01,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:01,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:56:01,310 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:56:01,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@730a1ca3[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:01,310 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,312 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,312 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:56:01,312 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:56:01,312 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:01,313 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,313 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:01,314 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:56:01,314 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:01,314 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,314 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:56:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:01,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:01,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:56:01,316 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:56:01,316 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:01,316 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:01,316 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,316 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:01,317 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,317 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,317 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:01,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:01,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,318 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:01,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,319 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:01,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,321 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:01,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:01,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:01,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:01,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:01,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:01,321 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:01,422 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:01,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:01,426 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:01,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:01,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,427 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:01,427 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:01,427 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:56:01,427 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:56:01,428 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,428 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,430 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:01,430 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:01,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:01,430 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:01,430 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:01,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:01,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,431 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,431 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:56:01,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:01,431 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:56:01,431 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:01,431 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:56:01,431 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:56:01,431 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:01,431 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:01,431 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:56:01,431 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:56:01,842 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010134e9641aa0134b23a09cdd369dea770f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010134e9641aa0134b23a09cdd369dea770f 2023-02-11 09:56:02,247 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/375247ce5efb479083fdc4e7a91eed96 2023-02-11 09:56:02,251 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/375247ce5efb479083fdc4e7a91eed96 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/375247ce5efb479083fdc4e7a91eed96 2023-02-11 09:56:02,254 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/375247ce5efb479083fdc4e7a91eed96, entries=1, sequenceid=29, filesize=4.9 K 2023-02-11 09:56:02,254 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 823ms, sequenceid=29, compaction requested=true 2023-02-11 09:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:02,254 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:56:02,254 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:56:02,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:56:02,255 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:56:02,256 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,256 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:02,256 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,256 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:02,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:02,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:56:02,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c3426f1[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:02,258 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:56:02,258 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,259 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,259 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:56:02,259 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:56:02,259 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:02,259 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,259 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:56:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:02,260 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:56:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:02,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:02,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:02,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:56:02,262 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:56:02,262 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:02,262 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:02,262 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,262 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:02,265 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,265 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:02,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,265 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:02,265 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:02,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,266 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,268 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,268 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,268 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:02,268 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:02,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:02,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:02,269 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:02,269 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:02,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:56:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:02,269 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,269 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:02,269 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:02,269 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:02,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:02,269 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,269 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,369 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:02,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:02,374 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:02,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:02,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,375 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:02,375 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:02,375 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:56:02,375 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:56:02,376 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,376 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,377 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,377 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:02,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:02,377 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:02,377 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:02,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:02,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,378 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,378 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:56:02,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:02,378 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:56:02,378 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:02,378 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:56:02,378 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:56:02,378 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:02,378 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:02,379 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:56:02,379 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:56:02,790 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c5da64f9efb840df84f3a70e343ab7a0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5da64f9efb840df84f3a70e343ab7a0 2023-02-11 09:56:03,195 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/fb97fc2547e0465389c387f3d131320b 2023-02-11 09:56:03,199 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/fb97fc2547e0465389c387f3d131320b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/fb97fc2547e0465389c387f3d131320b 2023-02-11 09:56:03,202 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/fb97fc2547e0465389c387f3d131320b, entries=1, sequenceid=33, filesize=4.9 K 2023-02-11 09:56:03,202 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 823ms, sequenceid=33, compaction requested=true 2023-02-11 09:56:03,202 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:03,202 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:03,202 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:56:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:56:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:56:03,203 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:56:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,204 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:03,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,204 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:03,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:03,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:56:03,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d0eb087[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:03,206 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:56:03,206 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,208 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:56:03,208 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:03,208 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,208 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:56:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:03,209 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,209 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:56:03,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:03,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:56:03,212 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:56:03,212 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:03,212 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:03,212 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,212 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:03,213 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,213 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:03,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,213 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:03,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:03,214 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,215 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:03,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,226 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,226 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,226 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:03,226 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:03,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:56:03,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:03,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:03,226 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:03,226 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:03,226 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:03,226 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,227 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,227 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,227 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:03,227 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:03,227 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:03,227 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:03,327 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:03,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:03,331 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:03,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:03,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,333 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:03,333 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:03,333 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:56:03,333 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:56:03,333 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,333 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,335 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:03,335 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:03,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:03,336 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:03,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,336 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:03,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:03,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,337 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,337 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:56:03,337 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:56:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:56:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:56:03,337 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:03,337 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:03,337 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:56:03,337 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:56:03,749 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090764bdfd1a86da47348df6044aaf9ef7ce to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090764bdfd1a86da47348df6044aaf9ef7ce 2023-02-11 09:56:04,154 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/e1a0e530a9274e6aa44f56e459fccdc2 2023-02-11 09:56:04,158 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/e1a0e530a9274e6aa44f56e459fccdc2 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/e1a0e530a9274e6aa44f56e459fccdc2 2023-02-11 09:56:04,161 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/e1a0e530a9274e6aa44f56e459fccdc2, entries=1, sequenceid=37, filesize=4.9 K 2023-02-11 09:56:04,161 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 824ms, sequenceid=37, compaction requested=true 2023-02-11 09:56:04,162 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:04,162 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:56:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:56:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:56:04,162 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:56:04,163 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,163 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,164 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:04,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:56:04,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b8c1b32[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:04,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:56:04,165 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,170 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,171 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:56:04,171 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,171 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:04,171 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:56:04,171 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:04,172 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:56:04,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:04,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:56:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:04,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:56:04,174 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:56:04,174 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:04,174 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:04,174 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,174 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:04,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,176 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:04,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:04,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:04,176 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,177 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,179 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:04,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:56:04,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:04,179 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:04,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:04,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,179 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:04,180 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,180 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:04,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:04,180 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:04,180 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:04,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:04,280 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:04,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:04,284 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:04,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:04,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,286 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:04,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:04,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-11 09:56:04,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-11 09:56:04,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,286 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,289 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,289 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:04,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:04,289 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:04,289 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:04,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,290 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-11 09:56:04,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:04,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-11 09:56:04,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:04,290 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-11 09:56:04,291 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 09:56:04,291 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:04,291 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:04,291 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. started... 2023-02-11 09:56:04,291 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e39c80b296834ae566568212c2e2862c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-11 09:56:04,703 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d2963341c3284291ae2d3c6bf0c25fe0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d2963341c3284291ae2d3c6bf0c25fe0 2023-02-11 09:56:05,108 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/c12764f4280746bd8c12ee9b937171b1 2023-02-11 09:56:05,112 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/c12764f4280746bd8c12ee9b937171b1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c12764f4280746bd8c12ee9b937171b1 2023-02-11 09:56:05,115 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c12764f4280746bd8c12ee9b937171b1, entries=1, sequenceid=41, filesize=4.9 K 2023-02-11 09:56:05,116 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e39c80b296834ae566568212c2e2862c in 825ms, sequenceid=41, compaction requested=true 2023-02-11 09:56:05,116 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:05,116 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 09:56:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 09:56:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-11 09:56:05,116 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-11 09:56:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,118 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:05,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-11 09:56:05,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3840e3e4[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:05,120 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-11 09:56:05,120 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,121 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-11 09:56:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-11 09:56:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:05,121 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,121 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:05,123 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-11 09:56:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-11 09:56:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:05,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:05,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-11 09:56:05,125 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-11 09:56:05,125 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:05,125 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:05,125 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,125 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:05,128 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,128 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:05,128 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:05,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:05,128 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,129 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:05,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:05,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-11 09:56:05,131 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-11 09:56:05,132 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:05,131 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:05,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:05,131 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,132 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:05,132 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:05,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:05,132 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:05,132 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,132 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,132 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,232 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:05,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:05,234 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-11 09:56:05,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:56:05,236 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:56:05,237 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109965237 2023-02-11 09:56:05,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:56:05,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-11 09:56:05,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-11 09:56:05,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:05,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x570b7597 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:56:05,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ac2f322, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:56:05,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:05,267 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032200d0af5ad7474bac1849ca82cbd714 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601032200d0af5ad7474bac1849ca82cbd714 2023-02-11 09:56:05,267 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:05,288 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:56:05,290 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:56:05,295 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:56:05,297 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37530, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:56:05,306 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe first=Optional[r5] last=Optional[r6] 2023-02-11 09:56:05,307 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe}] 2023-02-11 09:56:05,313 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe for inclusion in e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:56:05,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-11 09:56:05,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:56:05,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:05,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m1ha34678c5hpncrmqal1b6p3m0vni34tpcakqaksioqea1jbclce4dju7vdr8f2/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe 2023-02-11 09:56:05,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m1ha34678c5hpncrmqal1b6p3m0vni34tpcakqaksioqea1jbclce4dju7vdr8f2/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_ 2023-02-11 09:56:05,319 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m1ha34678c5hpncrmqal1b6p3m0vni34tpcakqaksioqea1jbclce4dju7vdr8f2/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe into e39c80b296834ae566568212c2e2862c/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_ - updating store file list. 2023-02-11 09:56:05,321 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_ into e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:56:05,322 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m1ha34678c5hpncrmqal1b6p3m0vni34tpcakqaksioqea1jbclce4dju7vdr8f2/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe into e39c80b296834ae566568212c2e2862c/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_) 2023-02-11 09:56:05,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m1ha34678c5hpncrmqal1b6p3m0vni34tpcakqaksioqea1jbclce4dju7vdr8f2/family1/7cd44f9ef5dd4a0c8bc0bb8c97029fbe 2023-02-11 09:56:05,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-11 09:56:05,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-11 09:56:05,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(1912): e39c80b296834ae566568212c2e2862c/family1 is initiating minor compaction 2023-02-11 09:56:05,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@90e878a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:56:05,325 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e39c80b296834ae566568212c2e2862c/family1 in testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:05,325 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/19e9c050a902473aa6d969a0f969e209, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c1ab85af6b2c4c74838016b2afa5e0fb, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c6e9bb250cec46eeba47b9abbae1eda8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/2b25a9e72d2d4413b84d9c44dfcc2748, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/0168e8a7648b415388c1560f10c41b70, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/375247ce5efb479083fdc4e7a91eed96, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/fb97fc2547e0465389c387f3d131320b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/e1a0e530a9274e6aa44f56e459fccdc2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c12764f4280746bd8c12ee9b937171b1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp, totalSize=49.7 K 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 19e9c050a902473aa6d969a0f969e209, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c1ab85af6b2c4c74838016b2afa5e0fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c6e9bb250cec46eeba47b9abbae1eda8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 2b25a9e72d2d4413b84d9c44dfcc2748, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 0168e8a7648b415388c1560f10c41b70, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 375247ce5efb479083fdc4e7a91eed96, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting fb97fc2547e0465389c387f3d131320b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting e1a0e530a9274e6aa44f56e459fccdc2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c12764f4280746bd8c12ee9b937171b1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-11 09:56:05,325 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 7bbacebb66b241ab87150e350b35f38b_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-11 09:56:05,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:05,327 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:05,329 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010134e9641aa0134b23a09cdd369dea770f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010134e9641aa0134b23a09cdd369dea770f 2023-02-11 09:56:05,330 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5da64f9efb840df84f3a70e343ab7a0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5da64f9efb840df84f3a70e343ab7a0 2023-02-11 09:56:05,330 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-11 09:56:05,330 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-11 09:56:05,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:05,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:05,374 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): e39c80b296834ae566568212c2e2862c#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:05,389 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ff98aebb70fa4039bd84e0323b2b3791 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ff98aebb70fa4039bd84e0323b2b3791 2023-02-11 09:56:05,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:05,413 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bfb1760f840c454386630f78b23d92c0 first=Optional[r1] last=Optional[r4] 2023-02-11 09:56:05,414 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bfb1760f840c454386630f78b23d92c0}] 2023-02-11 09:56:05,416 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bfb1760f840c454386630f78b23d92c0 for inclusion in e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:56:05,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-11 09:56:05,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:56:05,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:05,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bfb1760f840c454386630f78b23d92c0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4rv5ert54vs5a7sjnk7b6r6i64m87cbkm0diff7u3nktsho5nbbp487pdi4smbfk/family1/bfb1760f840c454386630f78b23d92c0 2023-02-11 09:56:05,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4rv5ert54vs5a7sjnk7b6r6i64m87cbkm0diff7u3nktsho5nbbp487pdi4smbfk/family1/bfb1760f840c454386630f78b23d92c0 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_ 2023-02-11 09:56:05,421 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4rv5ert54vs5a7sjnk7b6r6i64m87cbkm0diff7u3nktsho5nbbp487pdi4smbfk/family1/bfb1760f840c454386630f78b23d92c0 into e39c80b296834ae566568212c2e2862c/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_ - updating store file list. 2023-02-11 09:56:05,424 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_ into e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:56:05,424 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4rv5ert54vs5a7sjnk7b6r6i64m87cbkm0diff7u3nktsho5nbbp487pdi4smbfk/family1/bfb1760f840c454386630f78b23d92c0 into e39c80b296834ae566568212c2e2862c/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_) 2023-02-11 09:56:05,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__4rv5ert54vs5a7sjnk7b6r6i64m87cbkm0diff7u3nktsho5nbbp487pdi4smbfk/family1/bfb1760f840c454386630f78b23d92c0 2023-02-11 09:56:05,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:05,426 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:05,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013f4790c2934f420392f58c960d52153e to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013f4790c2934f420392f58c960d52153e 2023-02-11 09:56:05,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512056ab664fa96c241b4bb4322668919be3c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512056ab664fa96c241b4bb4322668919be3c 2023-02-11 09:56:05,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122807fbbdf3b07443fbadafc606c60601b9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122807fbbdf3b07443fbadafc606c60601b9 2023-02-11 09:56:05,432 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231da86b4c6656643dabd14ae52aaa9c5e6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231da86b4c6656643dabd14ae52aaa9c5e6 2023-02-11 09:56:05,432 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-11 09:56:05,432 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-11 09:56:05,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:05,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:05,465 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:56:05,465 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c3f2136 to 127.0.0.1:62294 2023-02-11 09:56:05,465 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:05,470 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:56:05,471 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37a80859 to 127.0.0.1:62294 2023-02-11 09:56:05,471 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:06,190 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/c096f7a70e5c41d48299864917060ae3 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c096f7a70e5c41d48299864917060ae3 2023-02-11 09:56:06,194 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e39c80b296834ae566568212c2e2862c/family1 of e39c80b296834ae566568212c2e2862c into c096f7a70e5c41d48299864917060ae3(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:56:06,194 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:06,194 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676109365325; duration=0sec 2023-02-11 09:56:06,194 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:56:06,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/19e9c050a902473aa6d969a0f969e209, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c1ab85af6b2c4c74838016b2afa5e0fb, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c6e9bb250cec46eeba47b9abbae1eda8, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/2b25a9e72d2d4413b84d9c44dfcc2748, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/0168e8a7648b415388c1560f10c41b70, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/375247ce5efb479083fdc4e7a91eed96, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/fb97fc2547e0465389c387f3d131320b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/e1a0e530a9274e6aa44f56e459fccdc2, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c12764f4280746bd8c12ee9b937171b1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_] to archive 2023-02-11 09:56:06,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:06,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/19e9c050a902473aa6d969a0f969e209 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/19e9c050a902473aa6d969a0f969e209 2023-02-11 09:56:06,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c1ab85af6b2c4c74838016b2afa5e0fb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c1ab85af6b2c4c74838016b2afa5e0fb 2023-02-11 09:56:06,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c6e9bb250cec46eeba47b9abbae1eda8 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c6e9bb250cec46eeba47b9abbae1eda8 2023-02-11 09:56:06,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/2b25a9e72d2d4413b84d9c44dfcc2748 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/2b25a9e72d2d4413b84d9c44dfcc2748 2023-02-11 09:56:06,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/0168e8a7648b415388c1560f10c41b70 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/0168e8a7648b415388c1560f10c41b70 2023-02-11 09:56:06,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/375247ce5efb479083fdc4e7a91eed96 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/375247ce5efb479083fdc4e7a91eed96 2023-02-11 09:56:06,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/fb97fc2547e0465389c387f3d131320b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/fb97fc2547e0465389c387f3d131320b 2023-02-11 09:56:06,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/e1a0e530a9274e6aa44f56e459fccdc2 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/e1a0e530a9274e6aa44f56e459fccdc2 2023-02-11 09:56:06,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c12764f4280746bd8c12ee9b937171b1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c12764f4280746bd8c12ee9b937171b1 2023-02-11 09:56:06,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7bbacebb66b241ab87150e350b35f38b_SeqId_44_ 2023-02-11 09:56:06,284 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a5902263768049318b2e997139de97ab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a5902263768049318b2e997139de97ab 2023-02-11 09:56:06,285 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:06,312 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a44dff6f62034320af9ef31ca087b331 first=Optional[r00] last=Optional[r8] 2023-02-11 09:56:06,313 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a44dff6f62034320af9ef31ca087b331}] 2023-02-11 09:56:06,315 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a44dff6f62034320af9ef31ca087b331 for inclusion in e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:56:06,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-11 09:56:06,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last= 2023-02-11 09:56:06,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:06,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a44dff6f62034320af9ef31ca087b331 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c19ego1dtjuvotqn3343j5okaaqv3hogvp0cbcptja4qn8poamk1i7nlamcqb53e/family1/a44dff6f62034320af9ef31ca087b331 2023-02-11 09:56:06,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c19ego1dtjuvotqn3343j5okaaqv3hogvp0cbcptja4qn8poamk1i7nlamcqb53e/family1/a44dff6f62034320af9ef31ca087b331 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_ 2023-02-11 09:56:06,321 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c19ego1dtjuvotqn3343j5okaaqv3hogvp0cbcptja4qn8poamk1i7nlamcqb53e/family1/a44dff6f62034320af9ef31ca087b331 into e39c80b296834ae566568212c2e2862c/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_ - updating store file list. 2023-02-11 09:56:06,324 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_ into e39c80b296834ae566568212c2e2862c/family1 2023-02-11 09:56:06,324 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c19ego1dtjuvotqn3343j5okaaqv3hogvp0cbcptja4qn8poamk1i7nlamcqb53e/family1/a44dff6f62034320af9ef31ca087b331 into e39c80b296834ae566568212c2e2862c/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_) 2023-02-11 09:56:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMinorCompactionWithMonthlyPolicy__c19ego1dtjuvotqn3343j5okaaqv3hogvp0cbcptja4qn8poamk1i7nlamcqb53e/family1/a44dff6f62034320af9ef31ca087b331 2023-02-11 09:56:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-11 09:56:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-11 09:56:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(1912): e39c80b296834ae566568212c2e2862c/family1 is initiating minor compaction (all files) 2023-02-11 09:56:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@179e82af; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:56:06,326 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e39c80b296834ae566568212c2e2862c/family1 in testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:06,326 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/bb3b2ba0b459459d9eab6ab3c564fdbb, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c096f7a70e5c41d48299864917060ae3, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp, totalSize=344.3 K 2023-02-11 09:56:06,327 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting bb3b2ba0b459459d9eab6ab3c564fdbb, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878839484 2023-02-11 09:56:06,327 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting c096f7a70e5c41d48299864917060ae3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621239484 2023-02-11 09:56:06,327 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting 7eca22813e8f412fb28bfbb7237538a9_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965239484 2023-02-11 09:56:06,328 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] compactions.Compactor(207): Compacting cf782b7cde3b4e878c8d454c412a2102_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014839484 2023-02-11 09:56:06,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:06,328 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:06,330 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d2963341c3284291ae2d3c6bf0c25fe0 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d2963341c3284291ae2d3c6bf0c25fe0 2023-02-11 09:56:06,331 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288bd652e4d7c14a289b0af9bb739efd89 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288bd652e4d7c14a289b0af9bb739efd89 2023-02-11 09:56:06,332 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130547a396e206642d6a4b5b540156dca01 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130547a396e206642d6a4b5b540156dca01 2023-02-11 09:56:06,332 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-11 09:56:06,332 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-11 09:56:06,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:06,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:06,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-11 09:56:06,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-11 09:56:06,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:56:06,335 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-11 09:56:06,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.1000 sec 2023-02-11 09:56:06,346 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] throttle.PressureAwareThroughputController(145): e39c80b296834ae566568212c2e2862c#family1#compaction#167 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:06,371 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/.tmp/family1/f2297f8f0ca7467e8c82d1c2c0038f76 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/f2297f8f0ca7467e8c82d1c2c0038f76 2023-02-11 09:56:06,376 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in e39c80b296834ae566568212c2e2862c/family1 of e39c80b296834ae566568212c2e2862c into f2297f8f0ca7467e8c82d1c2c0038f76(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:56:06,376 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e39c80b296834ae566568212c2e2862c: 2023-02-11 09:56:06,376 INFO [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1676109366326; duration=0sec 2023-02-11 09:56:06,376 DEBUG [RS:0;jenkins-hbase4:43463-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-11 09:56:06,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/bb3b2ba0b459459d9eab6ab3c564fdbb, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c096f7a70e5c41d48299864917060ae3, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_] to archive 2023-02-11 09:56:06,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:06,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/bb3b2ba0b459459d9eab6ab3c564fdbb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/bb3b2ba0b459459d9eab6ab3c564fdbb 2023-02-11 09:56:06,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c096f7a70e5c41d48299864917060ae3 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/c096f7a70e5c41d48299864917060ae3 2023-02-11 09:56:06,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/7eca22813e8f412fb28bfbb7237538a9_SeqId_46_ 2023-02-11 09:56:06,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_ to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/family1/cf782b7cde3b4e878c8d454c412a2102_SeqId_49_ 2023-02-11 09:56:06,497 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253 (was 252) - Thread LEAK? -, OpenFileDescriptor=635 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=123 (was 103) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 178), AvailableMemoryMB=2696 (was 3304) 2023-02-11 09:56:06,511 INFO [Listener at localhost/44465] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=253, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=123, ProcessCount=177, AvailableMemoryMB=2699 2023-02-11 09:56:06,530 DEBUG [Listener at localhost/44465] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-11 09:56:06,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-11 09:56:06,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-11 09:56:06,587 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 09:56:06,587 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-11 09:56:06,588 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 09:56:06,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 09:56:06,590 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:06,590 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:06,590 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:06,590 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de empty. 2023-02-11 09:56:06,590 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b empty. 2023-02-11 09:56:06,590 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab empty. 2023-02-11 09:56:06,591 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:06,591 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:06,591 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:06,591 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-11 09:56:06,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 09:56:06,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 09:56:06,998 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-11 09:56:07,000 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 69e0d7bba4cdf4cf871b9fa1d7cc5b7b, NAME => 'testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:56:07,000 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6ad1ef294ca5f3d2b7ed061c1853e3de, NAME => 'testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:56:07,000 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => fbafddcfb73c7f27cabd0c13b10473ab, NAME => 'testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/.tmp 2023-02-11 09:56:07,016 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:56:07,016 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 6ad1ef294ca5f3d2b7ed061c1853e3de, disabling compactions & flushes 2023-02-11 09:56:07,016 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:07,017 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:07,017 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. after waiting 0 ms 2023-02-11 09:56:07,017 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:07,017 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:07,017 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: Waiting for close lock at 1676109367016Disabling compacts and flushes for region at 1676109367016Disabling writes for close at 1676109367017 (+1 ms)Writing region close event to WAL at 1676109367017Closed at 1676109367017 2023-02-11 09:56:07,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 09:56:07,407 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:56:07,407 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 69e0d7bba4cdf4cf871b9fa1d7cc5b7b, disabling compactions & flushes 2023-02-11 09:56:07,407 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:07,407 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:07,407 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. after waiting 0 ms 2023-02-11 09:56:07,407 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:07,407 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:07,407 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: Waiting for close lock at 1676109367407Disabling compacts and flushes for region at 1676109367407Disabling writes for close at 1676109367407Writing region close event to WAL at 1676109367407Closed at 1676109367407 2023-02-11 09:56:07,412 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:56:07,412 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing fbafddcfb73c7f27cabd0c13b10473ab, disabling compactions & flushes 2023-02-11 09:56:07,412 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:07,412 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:07,412 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. after waiting 0 ms 2023-02-11 09:56:07,412 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:07,412 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:07,412 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for fbafddcfb73c7f27cabd0c13b10473ab: Waiting for close lock at 1676109367412Disabling compacts and flushes for region at 1676109367412Disabling writes for close at 1676109367412Writing region close event to WAL at 1676109367412Closed at 1676109367412 2023-02-11 09:56:07,414 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 09:56:07,415 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109367415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109367415"}]},"ts":"1676109367415"} 2023-02-11 09:56:07,415 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109367415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109367415"}]},"ts":"1676109367415"} 2023-02-11 09:56:07,415 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676109367415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676109367415"}]},"ts":"1676109367415"} 2023-02-11 09:56:07,417 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-11 09:56:07,417 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 09:56:07,417 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109367417"}]},"ts":"1676109367417"} 2023-02-11 09:56:07,418 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-11 09:56:07,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6ad1ef294ca5f3d2b7ed061c1853e3de, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbafddcfb73c7f27cabd0c13b10473ab, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=69e0d7bba4cdf4cf871b9fa1d7cc5b7b, ASSIGN}] 2023-02-11 09:56:07,422 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6ad1ef294ca5f3d2b7ed061c1853e3de, ASSIGN 2023-02-11 09:56:07,422 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=69e0d7bba4cdf4cf871b9fa1d7cc5b7b, ASSIGN 2023-02-11 09:56:07,422 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbafddcfb73c7f27cabd0c13b10473ab, ASSIGN 2023-02-11 09:56:07,423 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6ad1ef294ca5f3d2b7ed061c1853e3de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:56:07,423 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=69e0d7bba4cdf4cf871b9fa1d7cc5b7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:56:07,423 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbafddcfb73c7f27cabd0c13b10473ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43463,1676109215499; forceNewPlan=false, retain=false 2023-02-11 09:56:07,574 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=fbafddcfb73c7f27cabd0c13b10473ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:07,574 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=6ad1ef294ca5f3d2b7ed061c1853e3de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:07,575 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676109367574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109367574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109367574"}]},"ts":"1676109367574"} 2023-02-11 09:56:07,574 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=69e0d7bba4cdf4cf871b9fa1d7cc5b7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:07,575 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109367574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109367574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109367574"}]},"ts":"1676109367574"} 2023-02-11 09:56:07,575 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109367574"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676109367574"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676109367574"}]},"ts":"1676109367574"} 2023-02-11 09:56:07,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure fbafddcfb73c7f27cabd0c13b10473ab, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:56:07,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure 6ad1ef294ca5f3d2b7ed061c1853e3de, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:56:07,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 69e0d7bba4cdf4cf871b9fa1d7cc5b7b, server=jenkins-hbase4.apache.org,43463,1676109215499}] 2023-02-11 09:56:07,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 09:56:07,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:07,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fbafddcfb73c7f27cabd0c13b10473ab, NAME => 'testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab.', STARTKEY => '1', ENDKEY => '2'} 2023-02-11 09:56:07,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:56:07,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,752 INFO [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,753 DEBUG [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1 2023-02-11 09:56:07,754 DEBUG [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1 2023-02-11 09:56:07,754 INFO [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbafddcfb73c7f27cabd0c13b10473ab columnFamilyName family1 2023-02-11 09:56:07,755 INFO [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] regionserver.HStore(310): Store=fbafddcfb73c7f27cabd0c13b10473ab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:56:07,755 INFO [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,756 DEBUG [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2 2023-02-11 09:56:07,756 DEBUG [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2 2023-02-11 09:56:07,757 INFO [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbafddcfb73c7f27cabd0c13b10473ab columnFamilyName family2 2023-02-11 09:56:07,758 INFO [StoreOpener-fbafddcfb73c7f27cabd0c13b10473ab-1] regionserver.HStore(310): Store=fbafddcfb73c7f27cabd0c13b10473ab/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:56:07,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:56:07,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:07,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:56:07,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fbafddcfb73c7f27cabd0c13b10473ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67661716, jitterRate=0.008238136768341064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:56:07,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fbafddcfb73c7f27cabd0c13b10473ab: Running coprocessor pre-open hook at 1676109367731Writing region info on filesystem at 1676109367731Initializing all the Stores at 1676109367731Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109367731Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109367731Cleaning up temporary data from old regions at 1676109367759 (+28 ms)Cleaning up detritus from prior splits at 1676109367759Running coprocessor post-open hooks at 1676109367763 (+4 ms)Region opened successfully at 1676109367763 2023-02-11 09:56:07,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab., pid=120, masterSystemTime=1676109367728 2023-02-11 09:56:07,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:07,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:07,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:07,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6ad1ef294ca5f3d2b7ed061c1853e3de, NAME => 'testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de.', STARTKEY => '', ENDKEY => '1'} 2023-02-11 09:56:07,765 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=fbafddcfb73c7f27cabd0c13b10473ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:07,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:56:07,765 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676109367765"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109367765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109367765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109367765"}]},"ts":"1676109367765"} 2023-02-11 09:56:07,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-02-11 09:56:07,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure fbafddcfb73c7f27cabd0c13b10473ab, server=jenkins-hbase4.apache.org,43463,1676109215499 in 191 msec 2023-02-11 09:56:07,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=fbafddcfb73c7f27cabd0c13b10473ab, ASSIGN in 347 msec 2023-02-11 09:56:07,786 INFO [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,787 DEBUG [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1 2023-02-11 09:56:07,787 DEBUG [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1 2023-02-11 09:56:07,787 INFO [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ad1ef294ca5f3d2b7ed061c1853e3de columnFamilyName family1 2023-02-11 09:56:07,788 INFO [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] regionserver.HStore(310): Store=6ad1ef294ca5f3d2b7ed061c1853e3de/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:56:07,788 INFO [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,789 DEBUG [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2 2023-02-11 09:56:07,789 DEBUG [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2 2023-02-11 09:56:07,789 INFO [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ad1ef294ca5f3d2b7ed061c1853e3de columnFamilyName family2 2023-02-11 09:56:07,790 INFO [StoreOpener-6ad1ef294ca5f3d2b7ed061c1853e3de-1] regionserver.HStore(310): Store=6ad1ef294ca5f3d2b7ed061c1853e3de/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:56:07,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:56:07,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:07,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:56:07,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6ad1ef294ca5f3d2b7ed061c1853e3de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72917382, jitterRate=0.0865536630153656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:56:07,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: Running coprocessor pre-open hook at 1676109367766Writing region info on filesystem at 1676109367766Initializing all the Stores at 1676109367766Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109367766Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109367766Cleaning up temporary data from old regions at 1676109367791 (+25 ms)Cleaning up detritus from prior splits at 1676109367792 (+1 ms)Running coprocessor post-open hooks at 1676109367796 (+4 ms)Region opened successfully at 1676109367796 2023-02-11 09:56:07,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de., pid=121, masterSystemTime=1676109367728 2023-02-11 09:56:07,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:07,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:07,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:07,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 69e0d7bba4cdf4cf871b9fa1d7cc5b7b, NAME => 'testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b.', STARTKEY => '2', ENDKEY => ''} 2023-02-11 09:56:07,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,798 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=6ad1ef294ca5f3d2b7ed061c1853e3de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:07,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 09:56:07,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,799 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109367798"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109367798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109367798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109367798"}]},"ts":"1676109367798"} 2023-02-11 09:56:07,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=117 2023-02-11 09:56:07,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure 6ad1ef294ca5f3d2b7ed061c1853e3de, server=jenkins-hbase4.apache.org,43463,1676109215499 in 223 msec 2023-02-11 09:56:07,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6ad1ef294ca5f3d2b7ed061c1853e3de, ASSIGN in 380 msec 2023-02-11 09:56:07,822 INFO [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,823 DEBUG [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 2023-02-11 09:56:07,824 DEBUG [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 2023-02-11 09:56:07,824 INFO [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69e0d7bba4cdf4cf871b9fa1d7cc5b7b columnFamilyName family1 2023-02-11 09:56:07,825 INFO [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] regionserver.HStore(310): Store=69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:56:07,825 INFO [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,826 DEBUG [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2 2023-02-11 09:56:07,826 DEBUG [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2 2023-02-11 09:56:07,826 INFO [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69e0d7bba4cdf4cf871b9fa1d7cc5b7b columnFamilyName family2 2023-02-11 09:56:07,827 INFO [StoreOpener-69e0d7bba4cdf4cf871b9fa1d7cc5b7b-1] regionserver.HStore(310): Store=69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 09:56:07,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 09:56:07,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:07,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 09:56:07,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 69e0d7bba4cdf4cf871b9fa1d7cc5b7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60130275, jitterRate=-0.10398907959461212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 09:56:07,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: Running coprocessor pre-open hook at 1676109367799Writing region info on filesystem at 1676109367799Initializing all the Stores at 1676109367799Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109367799Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676109367800 (+1 ms)Cleaning up temporary data from old regions at 1676109367828 (+28 ms)Cleaning up detritus from prior splits at 1676109367829 (+1 ms)Running coprocessor post-open hooks at 1676109367832 (+3 ms)Region opened successfully at 1676109367832 2023-02-11 09:56:07,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b., pid=122, masterSystemTime=1676109367728 2023-02-11 09:56:07,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:07,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:07,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=69e0d7bba4cdf4cf871b9fa1d7cc5b7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:07,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676109367834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676109367834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676109367834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676109367834"}]},"ts":"1676109367834"} 2023-02-11 09:56:07,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-02-11 09:56:07,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 69e0d7bba4cdf4cf871b9fa1d7cc5b7b, server=jenkins-hbase4.apache.org,43463,1676109215499 in 258 msec 2023-02-11 09:56:07,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-11 09:56:07,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=69e0d7bba4cdf4cf871b9fa1d7cc5b7b, ASSIGN in 416 msec 2023-02-11 09:56:07,838 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 09:56:07,838 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676109367838"}]},"ts":"1676109367838"} 2023-02-11 09:56:07,839 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-11 09:56:07,841 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 09:56:07,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2560 sec 2023-02-11 09:56:08,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-11 09:56:08,693 INFO [Listener at localhost/44465] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-11 09:56:08,698 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:08,699 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:08,699 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:08,701 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:08,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 09:56:08,702 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 09:56:08,703 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:08,703 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 09:56:08,703 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 09:56:08,703 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:08,703 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:08,708 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:08,708 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:08,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:08,708 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:08,708 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:08,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:08,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:08,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 09:56:08,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 09:56:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 09:56:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:08,709 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 09:56:08,709 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:08,709 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. started... 2023-02-11 09:56:08,712 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:08,712 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:56:08,713 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. started... 2023-02-11 09:56:08,713 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:56:08,713 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fbafddcfb73c7f27cabd0c13b10473ab 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:56:08,713 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:08,713 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:08,713 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. started... 2023-02-11 09:56:08,714 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6ad1ef294ca5f3d2b7ed061c1853e3de 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-11 09:56:08,772 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211ba8daee6ade84187ac20c8e0f1621754 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211ba8daee6ade84187ac20c8e0f1621754 2023-02-11 09:56:08,780 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211fe452a8ed4ee4d6e88a7172935a71aad to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211fe452a8ed4ee4d6e88a7172935a71aad 2023-02-11 09:56:08,791 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/bec336f8fba34394a40492f075ab60b1 2023-02-11 09:56:09,166 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f8224b21b0484a2ab74740c7075038ed to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211f8224b21b0484a2ab74740c7075038ed 2023-02-11 09:56:09,197 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/5fa505f248c944c68117d8e6878b7c05 2023-02-11 09:56:09,234 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211d004c6689aac4a939f1b9d130ef72afb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230211d004c6689aac4a939f1b9d130ef72afb 2023-02-11 09:56:09,236 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302110aaa9e9aa64d4a159ac3e95d351d4f2b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302110aaa9e9aa64d4a159ac3e95d351d4f2b 2023-02-11 09:56:09,581 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/751ea2e2babe46a4b5b1009880c2ab5b 2023-02-11 09:56:09,614 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211f824c856396a4752939d1ce6c421ea49 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211f824c856396a4752939d1ce6c421ea49 2023-02-11 09:56:09,640 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/b0e0659f90594825a1aa728d5206b205 2023-02-11 09:56:09,644 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/5fa505f248c944c68117d8e6878b7c05 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/5fa505f248c944c68117d8e6878b7c05 2023-02-11 09:56:09,645 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/1dbb7e8347c0432baa6487f2c1ed37fe 2023-02-11 09:56:09,649 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/bec336f8fba34394a40492f075ab60b1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/bec336f8fba34394a40492f075ab60b1 2023-02-11 09:56:09,677 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/5fa505f248c944c68117d8e6878b7c05, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 09:56:09,677 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/b0e0659f90594825a1aa728d5206b205 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/b0e0659f90594825a1aa728d5206b205 2023-02-11 09:56:09,679 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/bec336f8fba34394a40492f075ab60b1, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 09:56:09,680 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/1dbb7e8347c0432baa6487f2c1ed37fe as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/1dbb7e8347c0432baa6487f2c1ed37fe 2023-02-11 09:56:09,681 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/b0e0659f90594825a1aa728d5206b205, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:56:09,682 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fbafddcfb73c7f27cabd0c13b10473ab in 969ms, sequenceid=5, compaction requested=false 2023-02-11 09:56:09,682 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-11 09:56:09,682 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:09,682 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:09,682 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:56:09,684 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/1dbb7e8347c0432baa6487f2c1ed37fe, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:56:09,685 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b in 973ms, sequenceid=5, compaction requested=false 2023-02-11 09:56:09,686 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:09,686 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:09,686 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:56:10,019 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/9bc3a2975a744cda9589b9302685f1c9 2023-02-11 09:56:10,023 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/751ea2e2babe46a4b5b1009880c2ab5b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/751ea2e2babe46a4b5b1009880c2ab5b 2023-02-11 09:56:10,047 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/751ea2e2babe46a4b5b1009880c2ab5b, entries=4, sequenceid=5, filesize=5.5 K 2023-02-11 09:56:10,048 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/9bc3a2975a744cda9589b9302685f1c9 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/9bc3a2975a744cda9589b9302685f1c9 2023-02-11 09:56:10,052 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/9bc3a2975a744cda9589b9302685f1c9, entries=2, sequenceid=5, filesize=5.1 K 2023-02-11 09:56:10,052 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6ad1ef294ca5f3d2b7ed061c1853e3de in 1338ms, sequenceid=5, compaction requested=false 2023-02-11 09:56:10,053 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:10,053 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:56:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:56:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 09:56:10,053 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 09:56:10,054 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,054 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:10,055 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,055 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:10,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 09:56:10,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@156e59b3[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:10,056 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 09:56:10,056 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,057 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,057 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 09:56:10,057 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 09:56:10,057 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,057 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:10,057 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:10,059 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 09:56:10,059 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,059 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:10,059 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 09:56:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:10,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 09:56:10,061 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 09:56:10,061 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:10,061 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:10,061 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 09:56:10,061 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:10,064 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,064 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:10,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,064 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:10,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:10,064 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:10,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,065 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,067 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,067 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:10,067 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:10,067 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:10,067 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:10,067 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 09:56:10,067 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:10,067 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,067 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:10,068 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:10,068 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:10,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:10,068 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,068 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:10,068 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:10,168 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:10,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:10,170 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:10,170 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:10,170 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:10,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:10,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:10,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 09:56:10,175 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 09:56:10,175 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:10,175 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 09:56:10,175 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 09:56:10,176 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,176 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:10,177 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:10,177 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:10,178 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:10,178 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:10,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:10,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 09:56:10,178 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 09:56:10,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 09:56:10,178 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 09:56:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 09:56:10,179 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:10,179 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. started... 2023-02-11 09:56:10,179 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:56:10,179 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:10,179 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:10,179 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. started... 2023-02-11 09:56:10,179 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:56:10,179 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6ad1ef294ca5f3d2b7ed061c1853e3de 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:56:10,179 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. started... 2023-02-11 09:56:10,179 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fbafddcfb73c7f27cabd0c13b10473ab 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-11 09:56:10,233 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302111d1ab3018c1140718ad595e8a6d99ef6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302111d1ab3018c1140718ad595e8a6d99ef6 2023-02-11 09:56:10,235 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302114a5cd51c9c574e6fb01fdbcda80b77d5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302114a5cd51c9c574e6fb01fdbcda80b77d5 2023-02-11 09:56:10,253 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/6ae05a4319664700b0e25db2fc21975a 2023-02-11 09:56:10,291 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211ac3c17f5ddb947e1bf278dd35b8d8277 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230211ac3c17f5ddb947e1bf278dd35b8d8277 2023-02-11 09:56:10,295 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/efd8693c197944799ab0d8d75d4fe8ab 2023-02-11 09:56:10,298 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/6ae05a4319664700b0e25db2fc21975a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/6ae05a4319664700b0e25db2fc21975a 2023-02-11 09:56:10,320 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/6ae05a4319664700b0e25db2fc21975a, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 09:56:10,321 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/efd8693c197944799ab0d8d75d4fe8ab as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/efd8693c197944799ab0d8d75d4fe8ab 2023-02-11 09:56:10,324 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/efd8693c197944799ab0d8d75d4fe8ab, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:56:10,325 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fbafddcfb73c7f27cabd0c13b10473ab in 146ms, sequenceid=9, compaction requested=false 2023-02-11 09:56:10,325 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:10,325 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:10,325 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:56:10,633 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211dc3fd19ce24b4b4988eabcec1408784c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211dc3fd19ce24b4b4988eabcec1408784c 2023-02-11 09:56:10,649 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/5d5793847f2340ca9ec5dd352e4fb86b 2023-02-11 09:56:11,048 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/1db510ed877e4d379420cab18e687b43 2023-02-11 09:56:11,081 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302115eb776809a354a468c8993acfd07b862 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302115eb776809a354a468c8993acfd07b862 2023-02-11 09:56:11,481 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b424c49a14424d089fa638f72d53d103 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230211b424c49a14424d089fa638f72d53d103 2023-02-11 09:56:11,485 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/b8c17b2260384bf3b4dfa01b7ff19e9f 2023-02-11 09:56:11,488 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/5d5793847f2340ca9ec5dd352e4fb86b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/5d5793847f2340ca9ec5dd352e4fb86b 2023-02-11 09:56:11,523 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/5d5793847f2340ca9ec5dd352e4fb86b, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 09:56:11,524 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/b8c17b2260384bf3b4dfa01b7ff19e9f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/b8c17b2260384bf3b4dfa01b7ff19e9f 2023-02-11 09:56:11,528 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/b8c17b2260384bf3b4dfa01b7ff19e9f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:56:11,528 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6ad1ef294ca5f3d2b7ed061c1853e3de in 1349ms, sequenceid=9, compaction requested=false 2023-02-11 09:56:11,528 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:11,528 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:56:11,885 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/efc8d511163848b8bcbdcc8bb0deff26 2023-02-11 09:56:11,889 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/1db510ed877e4d379420cab18e687b43 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/1db510ed877e4d379420cab18e687b43 2023-02-11 09:56:11,911 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/1db510ed877e4d379420cab18e687b43, entries=4, sequenceid=9, filesize=5.5 K 2023-02-11 09:56:11,912 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/efc8d511163848b8bcbdcc8bb0deff26 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/efc8d511163848b8bcbdcc8bb0deff26 2023-02-11 09:56:11,916 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/efc8d511163848b8bcbdcc8bb0deff26, entries=2, sequenceid=9, filesize=5.1 K 2023-02-11 09:56:11,916 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b in 1737ms, sequenceid=9, compaction requested=false 2023-02-11 09:56:11,916 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:11,916 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:11,916 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:56:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:56:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 09:56:11,917 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 09:56:11,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,918 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:11,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,918 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:11,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:11,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 09:56:11,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dac4911[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:11,920 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 09:56:11,920 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,924 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 09:56:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 09:56:11,924 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:11,924 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,924 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:11,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 09:56:11,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:11,925 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,925 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 09:56:11,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:11,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:11,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 09:56:11,927 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 09:56:11,927 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:11,927 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:11,927 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 09:56:11,927 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:11,929 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:11,929 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:11,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:11,929 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:11,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:11,929 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:11,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,930 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:11,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:11,933 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 09:56:11,933 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:11,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:11,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:11,933 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:12,033 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:12,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:12,035 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:12,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:12,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:12,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:12,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:12,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 09:56:12,039 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 09:56:12,039 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:12,039 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 09:56:12,039 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 09:56:12,040 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:12,040 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:12,042 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:12,042 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:12,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:12,043 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:12,043 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:12,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:12,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 09:56:12,044 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 09:56:12,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 09:56:12,044 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 09:56:12,044 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:12,044 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 09:56:12,044 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:12,044 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:56:12,044 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:12,044 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. started... 2023-02-11 09:56:12,044 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:12,044 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:12,044 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. started... 2023-02-11 09:56:12,044 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:56:12,044 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. started... 2023-02-11 09:56:12,044 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fbafddcfb73c7f27cabd0c13b10473ab 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:56:12,044 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6ad1ef294ca5f3d2b7ed061c1853e3de 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-11 09:56:12,105 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211d48cf1b1bc5847a589c6060ce5dc42a4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211d48cf1b1bc5847a589c6060ce5dc42a4 2023-02-11 09:56:12,106 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211f34b308034484101b98d47fb3600724b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211f34b308034484101b98d47fb3600724b 2023-02-11 09:56:12,120 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/8282f62a671d49d0a8ac9adde96fe2d5 2023-02-11 09:56:12,514 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302118e00a0334c664b2bbb5a699311be011d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302118e00a0334c664b2bbb5a699311be011d 2023-02-11 09:56:12,521 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/ae2735bbb9f14002b5b2aa6f45143e67 2023-02-11 09:56:12,551 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211940182e56ab74b98aac8c11daae8b75c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230211940182e56ab74b98aac8c11daae8b75c 2023-02-11 09:56:12,557 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/2781b174599644f6b51974621018a74b 2023-02-11 09:56:12,559 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302113b0f310b2f974dad82a0fc553bc9456c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302113b0f310b2f974dad82a0fc553bc9456c 2023-02-11 09:56:12,561 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/8282f62a671d49d0a8ac9adde96fe2d5 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/8282f62a671d49d0a8ac9adde96fe2d5 2023-02-11 09:56:12,563 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/ff74156170904bc484f6f67f3f47d0f9 2023-02-11 09:56:12,566 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/ae2735bbb9f14002b5b2aa6f45143e67 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/ae2735bbb9f14002b5b2aa6f45143e67 2023-02-11 09:56:12,588 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/ae2735bbb9f14002b5b2aa6f45143e67, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 09:56:12,589 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/ff74156170904bc484f6f67f3f47d0f9 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/ff74156170904bc484f6f67f3f47d0f9 2023-02-11 09:56:12,592 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/ff74156170904bc484f6f67f3f47d0f9, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:56:12,593 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fbafddcfb73c7f27cabd0c13b10473ab in 549ms, sequenceid=13, compaction requested=true 2023-02-11 09:56:12,593 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:12,593 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:12,593 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:56:12,595 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/8282f62a671d49d0a8ac9adde96fe2d5, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 09:56:12,596 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/2781b174599644f6b51974621018a74b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/2781b174599644f6b51974621018a74b 2023-02-11 09:56:12,600 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/2781b174599644f6b51974621018a74b, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:56:12,600 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b in 556ms, sequenceid=13, compaction requested=true 2023-02-11 09:56:12,600 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:12,600 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:56:12,932 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/bc81430d9f254a408126f74a6d67ea8b 2023-02-11 09:56:13,269 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 09:56:13,366 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211164bc90d9be347bc975f071c15a798b8 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211164bc90d9be347bc975f071c15a798b8 2023-02-11 09:56:13,771 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/2e10fb4948af4f09935360f3c1c66314 2023-02-11 09:56:13,775 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/bc81430d9f254a408126f74a6d67ea8b as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/bc81430d9f254a408126f74a6d67ea8b 2023-02-11 09:56:13,806 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/bc81430d9f254a408126f74a6d67ea8b, entries=4, sequenceid=13, filesize=5.5 K 2023-02-11 09:56:13,806 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/2e10fb4948af4f09935360f3c1c66314 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/2e10fb4948af4f09935360f3c1c66314 2023-02-11 09:56:13,810 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/2e10fb4948af4f09935360f3c1c66314, entries=2, sequenceid=13, filesize=5.1 K 2023-02-11 09:56:13,811 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6ad1ef294ca5f3d2b7ed061c1853e3de in 1767ms, sequenceid=13, compaction requested=true 2023-02-11 09:56:13,811 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:13,811 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:13,811 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:56:13,811 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:56:13,811 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,811 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 09:56:13,811 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 09:56:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,813 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,813 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 09:56:13,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26028c1d[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:13,814 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 09:56:13,814 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,817 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 09:56:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 09:56:13,817 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:13,817 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,817 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:13,818 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 09:56:13,818 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,818 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:13,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:13,818 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 09:56:13,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:13,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:13,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:13,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:13,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 09:56:13,821 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 09:56:13,821 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:13,821 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:13,821 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 09:56:13,821 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:13,822 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,822 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:13,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,822 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:13,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:13,823 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:13,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:13,824 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:13,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:13,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:13,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:13,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,826 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 09:56:13,826 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:13,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:13,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:13,826 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:13,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:13,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-11 09:56:13,826 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,827 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:13,827 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:13,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:13,827 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:13,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:13,827 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,927 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:13,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:13,929 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:13,929 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:13,929 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-11 09:56:13,931 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:13,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:13,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 09:56:13,933 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 09:56:13,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:13,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 09:56:13,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 09:56:13,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:13,938 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:13,938 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:13,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:13,938 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:13,938 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:13,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:13,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:13,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:13,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:13,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 09:56:13,939 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 09:56:13,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 09:56:13,939 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 09:56:13,939 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:13,939 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 09:56:13,940 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:13,940 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. started... 2023-02-11 09:56:13,940 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:13,940 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. started... 2023-02-11 09:56:13,940 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:56:13,940 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:13,940 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fbafddcfb73c7f27cabd0c13b10473ab 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:56:13,940 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:13,940 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:56:13,940 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. started... 2023-02-11 09:56:13,940 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6ad1ef294ca5f3d2b7ed061c1853e3de 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-11 09:56:13,997 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021129bfecc1bd6043eb9073566bc993c19c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021129bfecc1bd6043eb9073566bc993c19c 2023-02-11 09:56:14,003 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211849cafba42a54f6dadc83fe58f159c66 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211849cafba42a54f6dadc83fe58f159c66 2023-02-11 09:56:14,405 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211cf0d2b29da67469e80e2aaa70450aead to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211cf0d2b29da67469e80e2aaa70450aead 2023-02-11 09:56:14,411 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/37d572541d82491aa9659a43fe53dc5f 2023-02-11 09:56:14,418 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/ecdc2b0247724049a170651bcf83cb86 2023-02-11 09:56:14,425 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/0d9ace036b784bf19b00b2bd5fff4b48 2023-02-11 09:56:14,458 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302116e10a771f76f417db742d91538d38aed to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302116e10a771f76f417db742d91538d38aed 2023-02-11 09:56:14,471 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211009fb955ccdf454d9cb0479e16ea01a6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230211009fb955ccdf454d9cb0479e16ea01a6 2023-02-11 09:56:14,480 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/e10333df7a324b13b97542b5ddb25d1a 2023-02-11 09:56:14,482 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/219d3fe9eb0e4745bcd1f73b0d26cc23 2023-02-11 09:56:14,483 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/37d572541d82491aa9659a43fe53dc5f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/37d572541d82491aa9659a43fe53dc5f 2023-02-11 09:56:14,485 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/ecdc2b0247724049a170651bcf83cb86 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/ecdc2b0247724049a170651bcf83cb86 2023-02-11 09:56:14,507 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/37d572541d82491aa9659a43fe53dc5f, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 09:56:14,507 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/ecdc2b0247724049a170651bcf83cb86, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 09:56:14,508 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/e10333df7a324b13b97542b5ddb25d1a as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/e10333df7a324b13b97542b5ddb25d1a 2023-02-11 09:56:14,508 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/219d3fe9eb0e4745bcd1f73b0d26cc23 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/219d3fe9eb0e4745bcd1f73b0d26cc23 2023-02-11 09:56:14,511 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/e10333df7a324b13b97542b5ddb25d1a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:56:14,512 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/219d3fe9eb0e4745bcd1f73b0d26cc23, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:56:14,512 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fbafddcfb73c7f27cabd0c13b10473ab in 572ms, sequenceid=17, compaction requested=true 2023-02-11 09:56:14,512 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:14,512 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:14,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:56:14,513 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6ad1ef294ca5f3d2b7ed061c1853e3de in 573ms, sequenceid=17, compaction requested=true 2023-02-11 09:56:14,513 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:14,513 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:14,513 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:56:14,882 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021131e5248d5c83431bb29a66245def19a3 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021131e5248d5c83431bb29a66245def19a3 2023-02-11 09:56:14,886 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/a39fa988266e4114a3a9371f7b543a5d 2023-02-11 09:56:14,889 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/0d9ace036b784bf19b00b2bd5fff4b48 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/0d9ace036b784bf19b00b2bd5fff4b48 2023-02-11 09:56:14,925 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/0d9ace036b784bf19b00b2bd5fff4b48, entries=4, sequenceid=17, filesize=5.5 K 2023-02-11 09:56:14,926 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/a39fa988266e4114a3a9371f7b543a5d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/a39fa988266e4114a3a9371f7b543a5d 2023-02-11 09:56:14,929 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/a39fa988266e4114a3a9371f7b543a5d, entries=2, sequenceid=17, filesize=5.1 K 2023-02-11 09:56:14,930 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b in 990ms, sequenceid=17, compaction requested=true 2023-02-11 09:56:14,930 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:14,930 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 09:56:14,930 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 09:56:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,932 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,932 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:14,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 09:56:14,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e214fa[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:14,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 09:56:14,933 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,934 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 09:56:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 09:56:14,934 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:14,935 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,935 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:14,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 09:56:14,936 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:14,936 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 09:56:14,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:14,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:14,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:14,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:14,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 09:56:14,940 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 09:56:14,940 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:14,940 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:14,940 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 09:56:14,940 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:14,943 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:14,943 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:14,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:14,943 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:14,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:14,944 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:14,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:14,945 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:14,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:14,947 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:14,947 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 09:56:14,947 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:14,947 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:14,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-11 09:56:14,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:14,948 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:14,948 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:14,948 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:14,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:14,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:15,048 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:15,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:15,056 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:56:15,065 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:56:15,075 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:56:15,075 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:56:15,166 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 09:56:15,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-11 09:56:15,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-11 09:56:15,169 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-11 09:56:15,169 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:15,169 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-11 09:56:15,169 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-11 09:56:15,169 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:15,169 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:15,170 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:15,170 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:15,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:15,171 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:15,171 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 09:56:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:15,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 09:56:15,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:15,171 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-11 09:56:15,172 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-11 09:56:15,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-11 09:56:15,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-11 09:56:15,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 09:56:15,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-11 09:56:15,172 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:15,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-11 09:56:15,172 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 09:56:15,172 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. started... 2023-02-11 09:56:15,172 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:15,172 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:15,172 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:56:15,172 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. started... 2023-02-11 09:56:15,172 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. started... 2023-02-11 09:56:15,173 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6ad1ef294ca5f3d2b7ed061c1853e3de 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:56:15,173 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing fbafddcfb73c7f27cabd0c13b10473ab 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-11 09:56:15,223 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/74069abddee84436a0e034900c0a11f9 2023-02-11 09:56:15,227 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/9500dec971c14cfda23a059fde295f40 2023-02-11 09:56:15,250 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74069abddee84436a0e034900c0a11f9 2023-02-11 09:56:15,250 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9500dec971c14cfda23a059fde295f40 2023-02-11 09:56:15,273 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/a68b141d38004557bfbeb6c0ed3d9dcb 2023-02-11 09:56:15,277 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a68b141d38004557bfbeb6c0ed3d9dcb 2023-02-11 09:56:15,277 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/9500dec971c14cfda23a059fde295f40 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/9500dec971c14cfda23a059fde295f40 2023-02-11 09:56:15,312 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9500dec971c14cfda23a059fde295f40 2023-02-11 09:56:15,312 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/9500dec971c14cfda23a059fde295f40, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 09:56:15,313 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/a68b141d38004557bfbeb6c0ed3d9dcb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/a68b141d38004557bfbeb6c0ed3d9dcb 2023-02-11 09:56:15,316 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a68b141d38004557bfbeb6c0ed3d9dcb 2023-02-11 09:56:15,316 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/a68b141d38004557bfbeb6c0ed3d9dcb, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 09:56:15,316 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6ad1ef294ca5f3d2b7ed061c1853e3de in 143ms, sequenceid=23, compaction requested=true 2023-02-11 09:56:15,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:15,317 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:15,317 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-11 09:56:16,025 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/f4aca72b8e8241c5b92e2173d4522677 2023-02-11 09:56:16,049 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4aca72b8e8241c5b92e2173d4522677 2023-02-11 09:56:16,070 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/238f5b7253be474da3693f990cb1da4d 2023-02-11 09:56:16,073 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 238f5b7253be474da3693f990cb1da4d 2023-02-11 09:56:16,074 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/74069abddee84436a0e034900c0a11f9 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/74069abddee84436a0e034900c0a11f9 2023-02-11 09:56:16,098 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74069abddee84436a0e034900c0a11f9 2023-02-11 09:56:16,098 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/74069abddee84436a0e034900c0a11f9, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 09:56:16,098 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/238f5b7253be474da3693f990cb1da4d as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/238f5b7253be474da3693f990cb1da4d 2023-02-11 09:56:16,102 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 238f5b7253be474da3693f990cb1da4d 2023-02-11 09:56:16,102 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/238f5b7253be474da3693f990cb1da4d, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 09:56:16,103 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fbafddcfb73c7f27cabd0c13b10473ab in 930ms, sequenceid=23, compaction requested=true 2023-02-11 09:56:16,103 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:16,103 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:16,103 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-11 09:56:16,459 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/91ce9588e6374b64a93f3027c393d065 2023-02-11 09:56:16,463 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91ce9588e6374b64a93f3027c393d065 2023-02-11 09:56:16,463 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/f4aca72b8e8241c5b92e2173d4522677 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/f4aca72b8e8241c5b92e2173d4522677 2023-02-11 09:56:16,486 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4aca72b8e8241c5b92e2173d4522677 2023-02-11 09:56:16,486 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/f4aca72b8e8241c5b92e2173d4522677, entries=3, sequenceid=23, filesize=5.2 K 2023-02-11 09:56:16,487 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/91ce9588e6374b64a93f3027c393d065 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/91ce9588e6374b64a93f3027c393d065 2023-02-11 09:56:16,490 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91ce9588e6374b64a93f3027c393d065 2023-02-11 09:56:16,490 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/91ce9588e6374b64a93f3027c393d065, entries=1, sequenceid=23, filesize=5.0 K 2023-02-11 09:56:16,491 INFO [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b in 1319ms, sequenceid=23, compaction requested=true 2023-02-11 09:56:16,491 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:16,491 DEBUG [rs(jenkins-hbase4.apache.org,43463,1676109215499)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:16,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-11 09:56:16,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-11 09:56:16,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-11 09:56:16,491 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-11 09:56:16,493 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,493 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:16,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:16,493 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,493 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 09:56:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:16,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43463,1676109215499' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-11 09:56:16,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ea665b4[Count = 0] remaining members to acquire global barrier 2023-02-11 09:56:16,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-11 09:56:16,495 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,497 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,497 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-11 09:56:16,497 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-11 09:56:16,497 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,43463,1676109215499' in zk 2023-02-11 09:56:16,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,497 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 09:56:16,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-11 09:56:16,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:16,498 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,498 DEBUG [member: 'jenkins-hbase4.apache.org,43463,1676109215499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-11 09:56:16,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,43463,1676109215499': 2023-02-11 09:56:16,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43463,1676109215499' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-11 09:56:16,501 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-11 09:56:16,501 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 09:56:16,501 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 09:56:16,501 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-11 09:56:16,501 INFO [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 09:56:16,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:16,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:16,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:16,502 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 09:56:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 09:56:16,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 09:56:16,503 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 09:56:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:16,504 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 09:56:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-11 09:56:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:16,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-11 09:56:16,506 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 09:56:16,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 09:56:16,506 DEBUG [(jenkins-hbase4.apache.org,46823,1676109214337)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 09:56:16,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 09:56:16,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-11 09:56:16,506 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-11 09:56:16,606 DEBUG [Listener at localhost/44465] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 09:56:16,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46823] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 09:56:16,607 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:56:16,607 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 is initiating major compaction (all files) 2023-02-11 09:56:16,607 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:56:16,608 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:56:16,608 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 in testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:16,608 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/bec336f8fba34394a40492f075ab60b1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/1db510ed877e4d379420cab18e687b43, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/8282f62a671d49d0a8ac9adde96fe2d5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/0d9ace036b784bf19b00b2bd5fff4b48, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/f4aca72b8e8241c5b92e2173d4522677] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp, totalSize=27.1 K 2023-02-11 09:56:16,608 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting bec336f8fba34394a40492f075ab60b1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109368699 2023-02-11 09:56:16,609 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 1db510ed877e4d379420cab18e687b43, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109370170 2023-02-11 09:56:16,609 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 8282f62a671d49d0a8ac9adde96fe2d5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109372036 2023-02-11 09:56:16,609 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 0d9ace036b784bf19b00b2bd5fff4b48, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109373929 2023-02-11 09:56:16,610 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting f4aca72b8e8241c5b92e2173d4522677, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:56:16,617 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 69e0d7bba4cdf4cf871b9fa1d7cc5b7b#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:17,055 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211b8a5c9e562b049a6a73d80cbe807cef5_del 2023-02-11 09:56:17,055 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230211b8a5c9e562b049a6a73d80cbe807cef5_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211b8a5c9e562b049a6a73d80cbe807cef5_del 2023-02-11 09:56:17,925 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b36afd9c5a24e638c5f599708967254 2023-02-11 09:56:17,926 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family1/6b36afd9c5a24e638c5f599708967254 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/6b36afd9c5a24e638c5f599708967254 2023-02-11 09:56:17,948 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b36afd9c5a24e638c5f599708967254 2023-02-11 09:56:17,949 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 of 69e0d7bba4cdf4cf871b9fa1d7cc5b7b into 6b36afd9c5a24e638c5f599708967254(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:56:17,949 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:17,949 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:56:17,949 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2 is initiating major compaction (all files) 2023-02-11 09:56:17,949 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:56:17,949 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:56:17,950 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2 in testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:17,950 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/1dbb7e8347c0432baa6487f2c1ed37fe, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/efc8d511163848b8bcbdcc8bb0deff26, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/2781b174599644f6b51974621018a74b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/a39fa988266e4114a3a9371f7b543a5d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/91ce9588e6374b64a93f3027c393d065] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp, totalSize=25.4 K 2023-02-11 09:56:17,950 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 1dbb7e8347c0432baa6487f2c1ed37fe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109368699 2023-02-11 09:56:17,951 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting efc8d511163848b8bcbdcc8bb0deff26, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109370170 2023-02-11 09:56:17,951 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 2781b174599644f6b51974621018a74b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109372036 2023-02-11 09:56:17,951 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting a39fa988266e4114a3a9371f7b543a5d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109373929 2023-02-11 09:56:17,951 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 91ce9588e6374b64a93f3027c393d065, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:56:17,958 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 69e0d7bba4cdf4cf871b9fa1d7cc5b7b#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:18,030 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/bec336f8fba34394a40492f075ab60b1, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/1db510ed877e4d379420cab18e687b43, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/8282f62a671d49d0a8ac9adde96fe2d5, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/0d9ace036b784bf19b00b2bd5fff4b48, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/f4aca72b8e8241c5b92e2173d4522677] to archive 2023-02-11 09:56:18,031 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:18,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/bec336f8fba34394a40492f075ab60b1 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/bec336f8fba34394a40492f075ab60b1 2023-02-11 09:56:18,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/1db510ed877e4d379420cab18e687b43 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/1db510ed877e4d379420cab18e687b43 2023-02-11 09:56:18,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/8282f62a671d49d0a8ac9adde96fe2d5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/8282f62a671d49d0a8ac9adde96fe2d5 2023-02-11 09:56:18,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/0d9ace036b784bf19b00b2bd5fff4b48 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/0d9ace036b784bf19b00b2bd5fff4b48 2023-02-11 09:56:18,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/f4aca72b8e8241c5b92e2173d4522677 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/f4aca72b8e8241c5b92e2173d4522677 2023-02-11 09:56:18,366 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021154f42a93114c492ebbc9297d4224e388_del 2023-02-11 09:56:18,367 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021154f42a93114c492ebbc9297d4224e388_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021154f42a93114c492ebbc9297d4224e388_del 2023-02-11 09:56:19,179 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ece9f66f14647a7954098f675e31fcb 2023-02-11 09:56:19,180 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/.tmp/family2/0ece9f66f14647a7954098f675e31fcb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/0ece9f66f14647a7954098f675e31fcb 2023-02-11 09:56:19,184 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ece9f66f14647a7954098f675e31fcb 2023-02-11 09:56:19,185 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2 of 69e0d7bba4cdf4cf871b9fa1d7cc5b7b into 0ece9f66f14647a7954098f675e31fcb(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:56:19,185 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:19,185 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:56:19,185 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): fbafddcfb73c7f27cabd0c13b10473ab/family1 is initiating major compaction (all files) 2023-02-11 09:56:19,186 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:56:19,186 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:56:19,186 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of fbafddcfb73c7f27cabd0c13b10473ab/family1 in testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:19,186 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/5fa505f248c944c68117d8e6878b7c05, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/6ae05a4319664700b0e25db2fc21975a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/ae2735bbb9f14002b5b2aa6f45143e67, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/37d572541d82491aa9659a43fe53dc5f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/74069abddee84436a0e034900c0a11f9] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp, totalSize=27.1 K 2023-02-11 09:56:19,186 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 5fa505f248c944c68117d8e6878b7c05, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109368699 2023-02-11 09:56:19,187 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 6ae05a4319664700b0e25db2fc21975a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109370170 2023-02-11 09:56:19,187 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting ae2735bbb9f14002b5b2aa6f45143e67, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109372036 2023-02-11 09:56:19,187 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 37d572541d82491aa9659a43fe53dc5f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109373929 2023-02-11 09:56:19,188 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 74069abddee84436a0e034900c0a11f9, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:56:19,194 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): fbafddcfb73c7f27cabd0c13b10473ab#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:19,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/1dbb7e8347c0432baa6487f2c1ed37fe, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/efc8d511163848b8bcbdcc8bb0deff26, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/2781b174599644f6b51974621018a74b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/a39fa988266e4114a3a9371f7b543a5d, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/91ce9588e6374b64a93f3027c393d065] to archive 2023-02-11 09:56:19,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:19,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/1dbb7e8347c0432baa6487f2c1ed37fe to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/1dbb7e8347c0432baa6487f2c1ed37fe 2023-02-11 09:56:19,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/efc8d511163848b8bcbdcc8bb0deff26 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/efc8d511163848b8bcbdcc8bb0deff26 2023-02-11 09:56:19,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/2781b174599644f6b51974621018a74b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/2781b174599644f6b51974621018a74b 2023-02-11 09:56:19,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/a39fa988266e4114a3a9371f7b543a5d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/a39fa988266e4114a3a9371f7b543a5d 2023-02-11 09:56:19,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/91ce9588e6374b64a93f3027c393d065 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family2/91ce9588e6374b64a93f3027c393d065 2023-02-11 09:56:19,631 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211d20cadec589a41a6abaf495ca2ccbf25_del 2023-02-11 09:56:19,632 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211d20cadec589a41a6abaf495ca2ccbf25_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211d20cadec589a41a6abaf495ca2ccbf25_del 2023-02-11 09:56:20,083 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96aa94a159d9410fb2216908022c9498 2023-02-11 09:56:20,083 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family1/96aa94a159d9410fb2216908022c9498 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/96aa94a159d9410fb2216908022c9498 2023-02-11 09:56:20,105 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96aa94a159d9410fb2216908022c9498 2023-02-11 09:56:20,106 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fbafddcfb73c7f27cabd0c13b10473ab/family1 of fbafddcfb73c7f27cabd0c13b10473ab into 96aa94a159d9410fb2216908022c9498(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:56:20,106 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:20,106 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:56:20,106 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): fbafddcfb73c7f27cabd0c13b10473ab/family2 is initiating major compaction (all files) 2023-02-11 09:56:20,106 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:56:20,106 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:56:20,107 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of fbafddcfb73c7f27cabd0c13b10473ab/family2 in testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:20,107 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/b0e0659f90594825a1aa728d5206b205, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/efd8693c197944799ab0d8d75d4fe8ab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/ff74156170904bc484f6f67f3f47d0f9, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/e10333df7a324b13b97542b5ddb25d1a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/238f5b7253be474da3693f990cb1da4d] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp, totalSize=25.4 K 2023-02-11 09:56:20,107 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting b0e0659f90594825a1aa728d5206b205, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109368699 2023-02-11 09:56:20,108 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting efd8693c197944799ab0d8d75d4fe8ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109370170 2023-02-11 09:56:20,108 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting ff74156170904bc484f6f67f3f47d0f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109372036 2023-02-11 09:56:20,108 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting e10333df7a324b13b97542b5ddb25d1a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109373929 2023-02-11 09:56:20,109 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 238f5b7253be474da3693f990cb1da4d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:56:20,115 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): fbafddcfb73c7f27cabd0c13b10473ab#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:20,130 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/5fa505f248c944c68117d8e6878b7c05, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/6ae05a4319664700b0e25db2fc21975a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/ae2735bbb9f14002b5b2aa6f45143e67, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/37d572541d82491aa9659a43fe53dc5f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/74069abddee84436a0e034900c0a11f9] to archive 2023-02-11 09:56:20,131 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:20,132 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/5fa505f248c944c68117d8e6878b7c05 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/5fa505f248c944c68117d8e6878b7c05 2023-02-11 09:56:20,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/6ae05a4319664700b0e25db2fc21975a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/6ae05a4319664700b0e25db2fc21975a 2023-02-11 09:56:20,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/ae2735bbb9f14002b5b2aa6f45143e67 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/ae2735bbb9f14002b5b2aa6f45143e67 2023-02-11 09:56:20,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/37d572541d82491aa9659a43fe53dc5f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/37d572541d82491aa9659a43fe53dc5f 2023-02-11 09:56:20,135 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/74069abddee84436a0e034900c0a11f9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/74069abddee84436a0e034900c0a11f9 2023-02-11 09:56:20,522 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302110628d92c20a04da4987c2dfb1cc048a9_del 2023-02-11 09:56:20,523 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302110628d92c20a04da4987c2dfb1cc048a9_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302110628d92c20a04da4987c2dfb1cc048a9_del 2023-02-11 09:56:21,336 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4385700f7454f339a16d8a6864a3d3f 2023-02-11 09:56:21,336 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/.tmp/family2/d4385700f7454f339a16d8a6864a3d3f as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/d4385700f7454f339a16d8a6864a3d3f 2023-02-11 09:56:21,339 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4385700f7454f339a16d8a6864a3d3f 2023-02-11 09:56:21,340 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fbafddcfb73c7f27cabd0c13b10473ab/family2 of fbafddcfb73c7f27cabd0c13b10473ab into d4385700f7454f339a16d8a6864a3d3f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:56:21,340 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:21,341 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:56:21,341 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 6ad1ef294ca5f3d2b7ed061c1853e3de/family1 is initiating major compaction (all files) 2023-02-11 09:56:21,341 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:56:21,341 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:56:21,342 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 6ad1ef294ca5f3d2b7ed061c1853e3de/family1 in testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:21,342 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/751ea2e2babe46a4b5b1009880c2ab5b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/5d5793847f2340ca9ec5dd352e4fb86b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/bc81430d9f254a408126f74a6d67ea8b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/ecdc2b0247724049a170651bcf83cb86, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/9500dec971c14cfda23a059fde295f40] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp, totalSize=27.1 K 2023-02-11 09:56:21,342 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 751ea2e2babe46a4b5b1009880c2ab5b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109368698 2023-02-11 09:56:21,343 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 5d5793847f2340ca9ec5dd352e4fb86b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109370170 2023-02-11 09:56:21,343 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting bc81430d9f254a408126f74a6d67ea8b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109372035 2023-02-11 09:56:21,344 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting ecdc2b0247724049a170651bcf83cb86, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109373929 2023-02-11 09:56:21,344 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 9500dec971c14cfda23a059fde295f40, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:56:21,351 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 6ad1ef294ca5f3d2b7ed061c1853e3de#family1#compaction#202 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:21,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/b0e0659f90594825a1aa728d5206b205, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/efd8693c197944799ab0d8d75d4fe8ab, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/ff74156170904bc484f6f67f3f47d0f9, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/e10333df7a324b13b97542b5ddb25d1a, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/238f5b7253be474da3693f990cb1da4d] to archive 2023-02-11 09:56:21,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:21,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/b0e0659f90594825a1aa728d5206b205 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/b0e0659f90594825a1aa728d5206b205 2023-02-11 09:56:21,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/efd8693c197944799ab0d8d75d4fe8ab to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/efd8693c197944799ab0d8d75d4fe8ab 2023-02-11 09:56:21,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/ff74156170904bc484f6f67f3f47d0f9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/ff74156170904bc484f6f67f3f47d0f9 2023-02-11 09:56:21,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/e10333df7a324b13b97542b5ddb25d1a to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/e10333df7a324b13b97542b5ddb25d1a 2023-02-11 09:56:21,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/238f5b7253be474da3693f990cb1da4d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family2/238f5b7253be474da3693f990cb1da4d 2023-02-11 09:56:21,789 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211595671fffbc34790b102928f2c3cb54b_del 2023-02-11 09:56:21,789 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230211595671fffbc34790b102928f2c3cb54b_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211595671fffbc34790b102928f2c3cb54b_del 2023-02-11 09:56:22,258 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4261ee32317048719cdef7a391a01f59 2023-02-11 09:56:22,259 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family1/4261ee32317048719cdef7a391a01f59 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/4261ee32317048719cdef7a391a01f59 2023-02-11 09:56:22,281 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4261ee32317048719cdef7a391a01f59 2023-02-11 09:56:22,282 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6ad1ef294ca5f3d2b7ed061c1853e3de/family1 of 6ad1ef294ca5f3d2b7ed061c1853e3de into 4261ee32317048719cdef7a391a01f59(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-11 09:56:22,282 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:22,282 DEBUG [Listener at localhost/44465] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-11 09:56:22,282 DEBUG [Listener at localhost/44465] regionserver.HStore(1912): 6ad1ef294ca5f3d2b7ed061c1853e3de/family2 is initiating major compaction (all files) 2023-02-11 09:56:22,282 INFO [Listener at localhost/44465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 09:56:22,282 INFO [Listener at localhost/44465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 09:56:22,283 INFO [Listener at localhost/44465] regionserver.HRegion(2258): Starting compaction of 6ad1ef294ca5f3d2b7ed061c1853e3de/family2 in testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:22,283 INFO [Listener at localhost/44465] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/9bc3a2975a744cda9589b9302685f1c9, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/b8c17b2260384bf3b4dfa01b7ff19e9f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/2e10fb4948af4f09935360f3c1c66314, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/219d3fe9eb0e4745bcd1f73b0d26cc23, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/a68b141d38004557bfbeb6c0ed3d9dcb] into tmpdir=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp, totalSize=25.4 K 2023-02-11 09:56:22,283 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 9bc3a2975a744cda9589b9302685f1c9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676109368698 2023-02-11 09:56:22,284 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting b8c17b2260384bf3b4dfa01b7ff19e9f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676109370170 2023-02-11 09:56:22,284 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 2e10fb4948af4f09935360f3c1c66314, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676109372035 2023-02-11 09:56:22,284 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting 219d3fe9eb0e4745bcd1f73b0d26cc23, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676109373929 2023-02-11 09:56:22,285 DEBUG [Listener at localhost/44465] compactions.Compactor(207): Compacting a68b141d38004557bfbeb6c0ed3d9dcb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-11 09:56:22,291 INFO [Listener at localhost/44465] throttle.PressureAwareThroughputController(145): 6ad1ef294ca5f3d2b7ed061c1853e3de#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-11 09:56:22,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/751ea2e2babe46a4b5b1009880c2ab5b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/5d5793847f2340ca9ec5dd352e4fb86b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/bc81430d9f254a408126f74a6d67ea8b, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/ecdc2b0247724049a170651bcf83cb86, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/9500dec971c14cfda23a059fde295f40] to archive 2023-02-11 09:56:22,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:22,332 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/751ea2e2babe46a4b5b1009880c2ab5b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/751ea2e2babe46a4b5b1009880c2ab5b 2023-02-11 09:56:22,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/5d5793847f2340ca9ec5dd352e4fb86b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/5d5793847f2340ca9ec5dd352e4fb86b 2023-02-11 09:56:22,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/bc81430d9f254a408126f74a6d67ea8b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/bc81430d9f254a408126f74a6d67ea8b 2023-02-11 09:56:22,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/ecdc2b0247724049a170651bcf83cb86 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/ecdc2b0247724049a170651bcf83cb86 2023-02-11 09:56:22,336 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/9500dec971c14cfda23a059fde295f40 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/9500dec971c14cfda23a059fde295f40 2023-02-11 09:56:22,698 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302113b00c986135d4af0bd7fe1560ab0209e_del 2023-02-11 09:56:22,698 INFO [Listener at localhost/44465] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302113b00c986135d4af0bd7fe1560ab0209e_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302113b00c986135d4af0bd7fe1560ab0209e_del 2023-02-11 09:56:23,512 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3ee920ac93c4b7984af12ead7460044 2023-02-11 09:56:23,513 DEBUG [Listener at localhost/44465] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/.tmp/family2/a3ee920ac93c4b7984af12ead7460044 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/a3ee920ac93c4b7984af12ead7460044 2023-02-11 09:56:23,516 INFO [Listener at localhost/44465] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a3ee920ac93c4b7984af12ead7460044 2023-02-11 09:56:23,517 INFO [Listener at localhost/44465] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6ad1ef294ca5f3d2b7ed061c1853e3de/family2 of 6ad1ef294ca5f3d2b7ed061c1853e3de into a3ee920ac93c4b7984af12ead7460044(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-11 09:56:23,517 DEBUG [Listener at localhost/44465] regionserver.HRegion(2288): Compaction status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:23,520 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:56:23,522 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:56:23,525 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:56:23,526 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:56:23,530 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46823] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10]E\xB7\x9D[\x8A\xA5\x9C\xFB\x80\xC2\x8BP6U\xDD"\x10d\x83\x87\xE2\xEBex\x80\x82\x05\xD7\xE4Sb\xF6S*\x10\x13\x08Kg\x01|\x8E\xA5UU\xF2\xB2\xF6\x9D\x83\x192\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-11 09:56:23,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/9bc3a2975a744cda9589b9302685f1c9, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/b8c17b2260384bf3b4dfa01b7ff19e9f, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/2e10fb4948af4f09935360f3c1c66314, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/219d3fe9eb0e4745bcd1f73b0d26cc23, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/a68b141d38004557bfbeb6c0ed3d9dcb] to archive 2023-02-11 09:56:23,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:23,537 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/9bc3a2975a744cda9589b9302685f1c9 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/9bc3a2975a744cda9589b9302685f1c9 2023-02-11 09:56:23,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/b8c17b2260384bf3b4dfa01b7ff19e9f to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/b8c17b2260384bf3b4dfa01b7ff19e9f 2023-02-11 09:56:23,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/2e10fb4948af4f09935360f3c1c66314 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/2e10fb4948af4f09935360f3c1c66314 2023-02-11 09:56:23,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/219d3fe9eb0e4745bcd1f73b0d26cc23 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/219d3fe9eb0e4745bcd1f73b0d26cc23 2023-02-11 09:56:23,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/a68b141d38004557bfbeb6c0ed3d9dcb to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family2/a68b141d38004557bfbeb6c0ed3d9dcb 2023-02-11 09:56:23,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 09:56:23,554 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 09:56:23,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:56:23,554 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676109983554 2023-02-11 09:56:23,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-11 09:56:23,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-11 09:56:23,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230211595671fffbc34790b102928f2c3cb54b_del 2023-02-11 09:56:23,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230211d20cadec589a41a6abaf495ca2ccbf25_del 2023-02-11 09:56:23,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230211b8a5c9e562b049a6a73d80cbe807cef5_del 2023-02-11 09:56:23,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:23,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] zookeeper.ReadOnlyZKClient(139): Connect 0x408ffe73 to 127.0.0.1:62294 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 09:56:23,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@121539f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 09:56:23,943 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 09:56:24,102 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230211e3791061f7644204a8d4ce4c04baf849 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211e3791061f7644204a8d4ce4c04baf849 2023-02-11 09:56:24,102 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:24,113 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 09:56:24,116 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 09:56:24,123 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 09:56:24,125 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46084, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 09:56:24,155 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/7d6b70a3ce794c7f9bc90176d346a018 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-11 09:56:24,156 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/7d6b70a3ce794c7f9bc90176d346a018}] 2023-02-11 09:56:24,160 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/7d6b70a3ce794c7f9bc90176d346a018 for inclusion in fbafddcfb73c7f27cabd0c13b10473ab/family1 2023-02-11 09:56:24,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-11 09:56:24,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-11 09:56:24,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for fbafddcfb73c7f27cabd0c13b10473ab: 2023-02-11 09:56:24,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211/family1/7d6b70a3ce794c7f9bc90176d346a018 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__fvnfouqhnn47pfjabes9k022vhvmidofl1eakhivce4nq07dcp9lejtu3uhtrad/family1/7d6b70a3ce794c7f9bc90176d346a018 2023-02-11 09:56:24,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__fvnfouqhnn47pfjabes9k022vhvmidofl1eakhivce4nq07dcp9lejtu3uhtrad/family1/7d6b70a3ce794c7f9bc90176d346a018 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/2f9c58e4c72e4f988250dd9cef3c952c_SeqId_28_ 2023-02-11 09:56:24,184 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__fvnfouqhnn47pfjabes9k022vhvmidofl1eakhivce4nq07dcp9lejtu3uhtrad/family1/7d6b70a3ce794c7f9bc90176d346a018 into fbafddcfb73c7f27cabd0c13b10473ab/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/2f9c58e4c72e4f988250dd9cef3c952c_SeqId_28_ - updating store file list. 2023-02-11 09:56:24,205 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/2f9c58e4c72e4f988250dd9cef3c952c_SeqId_28_ into fbafddcfb73c7f27cabd0c13b10473ab/family1 2023-02-11 09:56:24,206 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__fvnfouqhnn47pfjabes9k022vhvmidofl1eakhivce4nq07dcp9lejtu3uhtrad/family1/7d6b70a3ce794c7f9bc90176d346a018 into fbafddcfb73c7f27cabd0c13b10473ab/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/family1/2f9c58e4c72e4f988250dd9cef3c952c_SeqId_28_) 2023-02-11 09:56:24,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__fvnfouqhnn47pfjabes9k022vhvmidofl1eakhivce4nq07dcp9lejtu3uhtrad/family1/7d6b70a3ce794c7f9bc90176d346a018 2023-02-11 09:56:24,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:24,208 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:24,210 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302111d1ab3018c1140718ad595e8a6d99ef6 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302111d1ab3018c1140718ad595e8a6d99ef6 2023-02-11 09:56:24,210 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021129bfecc1bd6043eb9073566bc993c19c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021129bfecc1bd6043eb9073566bc993c19c 2023-02-11 09:56:24,212 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211f34b308034484101b98d47fb3600724b to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211f34b308034484101b98d47fb3600724b 2023-02-11 09:56:24,213 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211fe452a8ed4ee4d6e88a7172935a71aad to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211fe452a8ed4ee4d6e88a7172935a71aad 2023-02-11 09:56:24,213 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 09:56:24,213 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230211' 2023-02-11 09:56:24,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 09:56:24,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 09:56:24,756 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302117d33f0bb5a8c4e16a7c4bc470e674404 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302117d33f0bb5a8c4e16a7c4bc470e674404 2023-02-11 09:56:24,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:24,806 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/2c9cc340d7ac43bbbd946180de5d1b22 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-11 09:56:24,807 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/2c9cc340d7ac43bbbd946180de5d1b22}] 2023-02-11 09:56:24,809 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/2c9cc340d7ac43bbbd946180de5d1b22 for inclusion in 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 2023-02-11 09:56:24,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-11 09:56:24,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-11 09:56:24,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: 2023-02-11 09:56:24,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211/family1/2c9cc340d7ac43bbbd946180de5d1b22 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__5khs10b30l7snr6nnjlf913j13v1qh474uojldfuoacsqj4mmib2ep5lb767iccm/family1/2c9cc340d7ac43bbbd946180de5d1b22 2023-02-11 09:56:24,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__5khs10b30l7snr6nnjlf913j13v1qh474uojldfuoacsqj4mmib2ep5lb767iccm/family1/2c9cc340d7ac43bbbd946180de5d1b22 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/43f6b10ad503478cae912a73548dfc51_SeqId_28_ 2023-02-11 09:56:24,833 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__5khs10b30l7snr6nnjlf913j13v1qh474uojldfuoacsqj4mmib2ep5lb767iccm/family1/2c9cc340d7ac43bbbd946180de5d1b22 into 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/43f6b10ad503478cae912a73548dfc51_SeqId_28_ - updating store file list. 2023-02-11 09:56:24,854 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/43f6b10ad503478cae912a73548dfc51_SeqId_28_ into 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 2023-02-11 09:56:24,854 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__5khs10b30l7snr6nnjlf913j13v1qh474uojldfuoacsqj4mmib2ep5lb767iccm/family1/2c9cc340d7ac43bbbd946180de5d1b22 into 69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/family1/43f6b10ad503478cae912a73548dfc51_SeqId_28_) 2023-02-11 09:56:24,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__5khs10b30l7snr6nnjlf913j13v1qh474uojldfuoacsqj4mmib2ep5lb767iccm/family1/2c9cc340d7ac43bbbd946180de5d1b22 2023-02-11 09:56:24,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:24,857 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:24,858 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211ba8daee6ade84187ac20c8e0f1621754 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211ba8daee6ade84187ac20c8e0f1621754 2023-02-11 09:56:24,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211cf0d2b29da67469e80e2aaa70450aead to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211cf0d2b29da67469e80e2aaa70450aead 2023-02-11 09:56:24,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211d48cf1b1bc5847a589c6060ce5dc42a4 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211d48cf1b1bc5847a589c6060ce5dc42a4 2023-02-11 09:56:24,861 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211dc3fd19ce24b4b4988eabcec1408784c to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211dc3fd19ce24b4b4988eabcec1408784c 2023-02-11 09:56:24,861 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 09:56:24,861 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230211' 2023-02-11 09:56:24,861 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 09:56:24,861 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 09:56:25,823 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302118469b66ab7fc42ef9b3e954b68a5dd86 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302118469b66ab7fc42ef9b3e954b68a5dd86 2023-02-11 09:56:25,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:25,861 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/49a18283964e4010b52b735b1c645039 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-11 09:56:25,862 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de., hostname=jenkins-hbase4.apache.org,43463,1676109215499, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/49a18283964e4010b52b735b1c645039}] 2023-02-11 09:56:25,864 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(763): Validating hfile at hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/49a18283964e4010b52b735b1c645039 for inclusion in 6ad1ef294ca5f3d2b7ed061c1853e3de/family1 2023-02-11 09:56:25,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-11 09:56:25,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(777): Region bounds: first= last=1 2023-02-11 09:56:25,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegion(2445): Flush status journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: 2023-02-11 09:56:25,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211/family1/49a18283964e4010b52b735b1c645039 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__jrtcha30he32asfqdp9bli1n926rda71ju8s55pd6f4bisiutmbq10jk11lo02tu/family1/49a18283964e4010b52b735b1c645039 2023-02-11 09:56:25,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__jrtcha30he32asfqdp9bli1n926rda71ju8s55pd6f4bisiutmbq10jk11lo02tu/family1/49a18283964e4010b52b735b1c645039 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/43859d90fd3e4daa9bee30384fdd5ed9_SeqId_28_ 2023-02-11 09:56:25,888 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(849): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__jrtcha30he32asfqdp9bli1n926rda71ju8s55pd6f4bisiutmbq10jk11lo02tu/family1/49a18283964e4010b52b735b1c645039 into 6ad1ef294ca5f3d2b7ed061c1853e3de/family1 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/43859d90fd3e4daa9bee30384fdd5ed9_SeqId_28_ - updating store file list. 2023-02-11 09:56:25,909 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(882): Loaded HFile hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/43859d90fd3e4daa9bee30384fdd5ed9_SeqId_28_ into 6ad1ef294ca5f3d2b7ed061c1853e3de/family1 2023-02-11 09:56:25,909 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.HStore(855): Successfully loaded hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__jrtcha30he32asfqdp9bli1n926rda71ju8s55pd6f4bisiutmbq10jk11lo02tu/family1/49a18283964e4010b52b735b1c645039 into 6ad1ef294ca5f3d2b7ed061c1853e3de/family1 (new location: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/family1/43859d90fd3e4daa9bee30384fdd5ed9_SeqId_28_) 2023-02-11 09:56:25,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43463] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/staging/jenkins__testMajorCompactionFromAdmin__jrtcha30he32asfqdp9bli1n926rda71ju8s55pd6f4bisiutmbq10jk11lo02tu/family1/49a18283964e4010b52b735b1c645039 2023-02-11 09:56:25,911 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230211 table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:25,911 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:25,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302114a5cd51c9c574e6fb01fdbcda80b77d5 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302114a5cd51c9c574e6fb01fdbcda80b77d5 2023-02-11 09:56:25,914 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211849cafba42a54f6dadc83fe58f159c66 to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211849cafba42a54f6dadc83fe58f159c66 2023-02-11 09:56:25,914 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302118e00a0334c664b2bbb5a699311be011d to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302118e00a0334c664b2bbb5a699311be011d 2023-02-11 09:56:25,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211f8224b21b0484a2ab74740c7075038ed to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211f8224b21b0484a2ab74740c7075038ed 2023-02-11 09:56:25,915 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-11 09:56:25,915 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230211' 2023-02-11 09:56:25,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230211 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 09:56:25,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-11 09:56:25,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-11 09:56:25,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211595671fffbc34790b102928f2c3cb54b_del] 2023-02-11 09:56:25,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:25,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211595671fffbc34790b102928f2c3cb54b_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230211595671fffbc34790b102928f2c3cb54b_del 2023-02-11 09:56:25,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 09:56:25,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211d20cadec589a41a6abaf495ca2ccbf25_del] 2023-02-11 09:56:25,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:25,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211d20cadec589a41a6abaf495ca2ccbf25_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230211d20cadec589a41a6abaf495ca2ccbf25_del 2023-02-11 09:56:25,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 09:56:25,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211b8a5c9e562b049a6a73d80cbe807cef5_del] 2023-02-11 09:56:25,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] backup.HFileArchiver(360): Archiving compacted files. 2023-02-11 09:56:25,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211b8a5c9e562b049a6a73d80cbe807cef5_del to hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230211b8a5c9e562b049a6a73d80cbe807cef5_del 2023-02-11 09:56:25,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-11 09:56:25,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676109219413] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-11 09:56:25,921 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-11 09:56:25,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.3690 sec 2023-02-11 09:56:25,937 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:56:25,939 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:56:25,941 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-11 09:56:25,942 DEBUG [Listener at localhost/44465] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-11 09:56:25,947 INFO [Listener at localhost/44465] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 09:56:25,991 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:56:25,992 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x408ffe73 to 127.0.0.1:62294 2023-02-11 09:56:25,992 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:25,992 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:56:25,992 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x570b7597 to 127.0.0.1:62294 2023-02-11 09:56:25,992 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:26,017 INFO [Listener at localhost/44465] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=243 (was 253), OpenFileDescriptor=633 (was 635), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 123) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 177), AvailableMemoryMB=2703 (was 2699) - AvailableMemoryMB LEAK? - 2023-02-11 09:56:26,018 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7defec53 to 127.0.0.1:62294 2023-02-11 09:56:26,018 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:26,019 INFO [Listener at localhost/44465] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 09:56:26,019 INFO [Listener at localhost/44465] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 09:56:26,019 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0629018b to 127.0.0.1:62294 2023-02-11 09:56:26,019 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:26,019 DEBUG [Listener at localhost/44465] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 09:56:26,019 DEBUG [Listener at localhost/44465] util.JVMClusterUtil(257): Found active master hash=869757023, stopped=false 2023-02-11 09:56:26,019 INFO [Listener at localhost/44465] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:56:26,021 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 09:56:26,022 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 09:56:26,022 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:56:26,022 INFO [Listener at localhost/44465] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 09:56:26,022 DEBUG [Listener at localhost/44465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78d81643 to 127.0.0.1:62294 2023-02-11 09:56:26,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 09:56:26,022 DEBUG [Listener at localhost/44465] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:26,022 INFO [Listener at localhost/44465] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43463,1676109215499' ***** 2023-02-11 09:56:26,022 INFO [Listener at localhost/44465] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 09:56:26,023 INFO [RS:0;jenkins-hbase4:43463] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 09:56:26,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 09:56:26,023 INFO [RS:0;jenkins-hbase4:43463] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 09:56:26,023 INFO [RS:0;jenkins-hbase4:43463] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 09:56:26,023 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 3f82f0c310b3fe5314afe7844ad07bca 2023-02-11 09:56:26,024 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for da22992fcdb8645f6d18a6b22b1a57ae 2023-02-11 09:56:26,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f82f0c310b3fe5314afe7844ad07bca, disabling compactions & flushes 2023-02-11 09:56:26,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:56:26,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:56:26,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. after waiting 0 ms 2023-02-11 09:56:26,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:56:26,024 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for b9e6247c3c7f22b5fe2c5b9ec537ba6e 2023-02-11 09:56:26,024 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 09:56:26,024 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b 2023-02-11 09:56:26,024 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 468aeccb8d22c50304be9feb00b5922a 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 016732cf600178157bb892db15fc6720 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 8ae1a139e38795e298a38629c4c20c98 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for e39c80b296834ae566568212c2e2862c 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 673673bfe0aa18b892e937412149ace8 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for f2aa1f4e83b52c040476aa6bd5c21877 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 7db8f71fb7d3b894b4386ef896bc3366 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 35649d2f915e53acc4ab9daa7e90d4fc 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 9facb323010a262708498579be7487c4 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for ffaa59391868e3b78654a134d119206a 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for fbafddcfb73c7f27cabd0c13b10473ab 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for fdf5a340462b75ac8dcb6a5d2682295f 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for df6d5a64fc3bfc03d66e239964a4e80d 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 6ad1ef294ca5f3d2b7ed061c1853e3de 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for e473f47fdbb8d1df882d5c22130ea71f 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 006ee9d5c2deae1724621309680e97ab 2023-02-11 09:56:26,025 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:26,025 DEBUG [RS:0;jenkins-hbase4:43463] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x114e4c29 to 127.0.0.1:62294 2023-02-11 09:56:26,025 DEBUG [RS:0;jenkins-hbase4:43463] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:26,026 INFO [RS:0;jenkins-hbase4:43463] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 09:56:26,026 INFO [RS:0;jenkins-hbase4:43463] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 09:56:26,026 INFO [RS:0;jenkins-hbase4:43463] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 09:56:26,026 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 09:56:26,026 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-11 09:56:26,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 09:56:26,027 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 09:56:26,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 09:56:26,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 09:56:26,027 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 09:56:26,027 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-11 09:56:26,027 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1505): Waiting on 006ee9d5c2deae1724621309680e97ab, 016732cf600178157bb892db15fc6720, 1588230740, 35649d2f915e53acc4ab9daa7e90d4fc, 3f82f0c310b3fe5314afe7844ad07bca, 468aeccb8d22c50304be9feb00b5922a, 673673bfe0aa18b892e937412149ace8, 69e0d7bba4cdf4cf871b9fa1d7cc5b7b, 6ad1ef294ca5f3d2b7ed061c1853e3de, 7db8f71fb7d3b894b4386ef896bc3366, 8ae1a139e38795e298a38629c4c20c98, 9facb323010a262708498579be7487c4, b9e6247c3c7f22b5fe2c5b9ec537ba6e, da22992fcdb8645f6d18a6b22b1a57ae, df6d5a64fc3bfc03d66e239964a4e80d, e39c80b296834ae566568212c2e2862c, e473f47fdbb8d1df882d5c22130ea71f, f2aa1f4e83b52c040476aa6bd5c21877, fbafddcfb73c7f27cabd0c13b10473ab, fdf5a340462b75ac8dcb6a5d2682295f, ffaa59391868e3b78654a134d119206a 2023-02-11 09:56:26,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/3f82f0c310b3fe5314afe7844ad07bca/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-02-11 09:56:26,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:56:26,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f82f0c310b3fe5314afe7844ad07bca: Waiting for close lock at 1676109386024Running coprocessor pre-close hooks at 1676109386024Disabling compacts and flushes for region at 1676109386024Disabling writes for close at 1676109386024Writing region close event to WAL at 1676109386025 (+1 ms)Running coprocessor post-close hooks at 1676109386029 (+4 ms)Closed at 1676109386029 2023-02-11 09:56:26,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676109219525.3f82f0c310b3fe5314afe7844ad07bca. 2023-02-11 09:56:26,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da22992fcdb8645f6d18a6b22b1a57ae, disabling compactions & flushes 2023-02-11 09:56:26,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:56:26,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:56:26,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. after waiting 0 ms 2023-02-11 09:56:26,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:56:26,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/da22992fcdb8645f6d18a6b22b1a57ae/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 09:56:26,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:56:26,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da22992fcdb8645f6d18a6b22b1a57ae: Waiting for close lock at 1676109386030Running coprocessor pre-close hooks at 1676109386030Disabling compacts and flushes for region at 1676109386030Disabling writes for close at 1676109386030Writing region close event to WAL at 1676109386030Running coprocessor post-close hooks at 1676109386033 (+3 ms)Closed at 1676109386033 2023-02-11 09:56:26,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676109257192.da22992fcdb8645f6d18a6b22b1a57ae. 2023-02-11 09:56:26,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b9e6247c3c7f22b5fe2c5b9ec537ba6e, disabling compactions & flushes 2023-02-11 09:56:26,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:56:26,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:56:26,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. after waiting 0 ms 2023-02-11 09:56:26,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:56:26,039 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-11 09:56:26,041 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/.tmp/info/fdef92ca45c34bf588c17aefe3a5306c 2023-02-11 09:56:26,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/b9e6247c3c7f22b5fe2c5b9ec537ba6e/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 09:56:26,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:56:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b9e6247c3c7f22b5fe2c5b9ec537ba6e: Waiting for close lock at 1676109386034Running coprocessor pre-close hooks at 1676109386034Disabling compacts and flushes for region at 1676109386034Disabling writes for close at 1676109386034Writing region close event to WAL at 1676109386039 (+5 ms)Running coprocessor post-close hooks at 1676109386042 (+3 ms)Closed at 1676109386043 (+1 ms) 2023-02-11 09:56:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676109312561.b9e6247c3c7f22b5fe2c5b9ec537ba6e. 2023-02-11 09:56:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 69e0d7bba4cdf4cf871b9fa1d7cc5b7b, disabling compactions & flushes 2023-02-11 09:56:26,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. after waiting 0 ms 2023-02-11 09:56:26,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:26,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdef92ca45c34bf588c17aefe3a5306c 2023-02-11 09:56:26,046 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 09:56:26,046 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 09:56:26,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/69e0d7bba4cdf4cf871b9fa1d7cc5b7b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 09:56:26,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:26,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 69e0d7bba4cdf4cf871b9fa1d7cc5b7b: Waiting for close lock at 1676109386043Running coprocessor pre-close hooks at 1676109386043Disabling compacts and flushes for region at 1676109386043Disabling writes for close at 1676109386043Writing region close event to WAL at 1676109386044 (+1 ms)Running coprocessor post-close hooks at 1676109386048 (+4 ms)Closed at 1676109386049 (+1 ms) 2023-02-11 09:56:26,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676109366554.69e0d7bba4cdf4cf871b9fa1d7cc5b7b. 2023-02-11 09:56:26,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 468aeccb8d22c50304be9feb00b5922a, disabling compactions & flushes 2023-02-11 09:56:26,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:56:26,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:56:26,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. after waiting 0 ms 2023-02-11 09:56:26,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:56:26,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/468aeccb8d22c50304be9feb00b5922a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 09:56:26,055 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/.tmp/rep_barrier/e1345e28a00b4448b697e0b180ebb2f5 2023-02-11 09:56:26,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:56:26,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 468aeccb8d22c50304be9feb00b5922a: Waiting for close lock at 1676109386049Running coprocessor pre-close hooks at 1676109386049Disabling compacts and flushes for region at 1676109386049Disabling writes for close at 1676109386049Writing region close event to WAL at 1676109386050 (+1 ms)Running coprocessor post-close hooks at 1676109386055 (+5 ms)Closed at 1676109386056 (+1 ms) 2023-02-11 09:56:26,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676109338596.468aeccb8d22c50304be9feb00b5922a. 2023-02-11 09:56:26,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 016732cf600178157bb892db15fc6720, disabling compactions & flushes 2023-02-11 09:56:26,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:56:26,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:56:26,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. after waiting 0 ms 2023-02-11 09:56:26,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:56:26,060 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1345e28a00b4448b697e0b180ebb2f5 2023-02-11 09:56:26,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/016732cf600178157bb892db15fc6720/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 09:56:26,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:56:26,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 016732cf600178157bb892db15fc6720: Waiting for close lock at 1676109386056Running coprocessor pre-close hooks at 1676109386056Disabling compacts and flushes for region at 1676109386056Disabling writes for close at 1676109386057 (+1 ms)Writing region close event to WAL at 1676109386063 (+6 ms)Running coprocessor post-close hooks at 1676109386067 (+4 ms)Closed at 1676109386067 2023-02-11 09:56:26,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676109312561.016732cf600178157bb892db15fc6720. 2023-02-11 09:56:26,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8ae1a139e38795e298a38629c4c20c98, disabling compactions & flushes 2023-02-11 09:56:26,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:56:26,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:56:26,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. after waiting 0 ms 2023-02-11 09:56:26,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:56:26,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/8ae1a139e38795e298a38629c4c20c98/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 09:56:26,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:56:26,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8ae1a139e38795e298a38629c4c20c98: Waiting for close lock at 1676109386068Running coprocessor pre-close hooks at 1676109386068Disabling compacts and flushes for region at 1676109386068Disabling writes for close at 1676109386068Writing region close event to WAL at 1676109386072 (+4 ms)Running coprocessor post-close hooks at 1676109386075 (+3 ms)Closed at 1676109386075 2023-02-11 09:56:26,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676109338596.8ae1a139e38795e298a38629c4c20c98. 2023-02-11 09:56:26,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e39c80b296834ae566568212c2e2862c, disabling compactions & flushes 2023-02-11 09:56:26,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:26,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:26,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. after waiting 0 ms 2023-02-11 09:56:26,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:26,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithMonthlyPolicy/e39c80b296834ae566568212c2e2862c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-11 09:56:26,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:26,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e39c80b296834ae566568212c2e2862c: Waiting for close lock at 1676109386076Running coprocessor pre-close hooks at 1676109386076Disabling compacts and flushes for region at 1676109386076Disabling writes for close at 1676109386076Writing region close event to WAL at 1676109386076Running coprocessor post-close hooks at 1676109386079 (+3 ms)Closed at 1676109386080 (+1 ms) 2023-02-11 09:56:26,080 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 09:56:26,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676109353567.e39c80b296834ae566568212c2e2862c. 2023-02-11 09:56:26,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 673673bfe0aa18b892e937412149ace8, disabling compactions & flushes 2023-02-11 09:56:26,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:56:26,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:56:26,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. after waiting 0 ms 2023-02-11 09:56:26,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:56:26,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/673673bfe0aa18b892e937412149ace8/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-11 09:56:26,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:56:26,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 673673bfe0aa18b892e937412149ace8: Waiting for close lock at 1676109386080Running coprocessor pre-close hooks at 1676109386080Disabling compacts and flushes for region at 1676109386080Disabling writes for close at 1676109386080Writing region close event to WAL at 1676109386081 (+1 ms)Running coprocessor post-close hooks at 1676109386083 (+2 ms)Closed at 1676109386084 (+1 ms) 2023-02-11 09:56:26,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676109257192.673673bfe0aa18b892e937412149ace8. 2023-02-11 09:56:26,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f2aa1f4e83b52c040476aa6bd5c21877, disabling compactions & flushes 2023-02-11 09:56:26,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:56:26,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:56:26,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. after waiting 0 ms 2023-02-11 09:56:26,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:56:26,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/ns/testMinorCompaction/f2aa1f4e83b52c040476aa6bd5c21877/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 09:56:26,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:56:26,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f2aa1f4e83b52c040476aa6bd5c21877: Waiting for close lock at 1676109386084Running coprocessor pre-close hooks at 1676109386084Disabling compacts and flushes for region at 1676109386084Disabling writes for close at 1676109386084Writing region close event to WAL at 1676109386085 (+1 ms)Running coprocessor post-close hooks at 1676109386088 (+3 ms)Closed at 1676109386088 2023-02-11 09:56:26,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676109338596.f2aa1f4e83b52c040476aa6bd5c21877. 2023-02-11 09:56:26,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7db8f71fb7d3b894b4386ef896bc3366, disabling compactions & flushes 2023-02-11 09:56:26,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:56:26,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:56:26,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. after waiting 0 ms 2023-02-11 09:56:26,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:56:26,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyPolicy/7db8f71fb7d3b894b4386ef896bc3366/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 09:56:26,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:56:26,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7db8f71fb7d3b894b4386ef896bc3366: Waiting for close lock at 1676109386088Running coprocessor pre-close hooks at 1676109386088Disabling compacts and flushes for region at 1676109386088Disabling writes for close at 1676109386089 (+1 ms)Writing region close event to WAL at 1676109386089Running coprocessor post-close hooks at 1676109386092 (+3 ms)Closed at 1676109386092 2023-02-11 09:56:26,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676109261789.7db8f71fb7d3b894b4386ef896bc3366. 2023-02-11 09:56:26,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 35649d2f915e53acc4ab9daa7e90d4fc, disabling compactions & flushes 2023-02-11 09:56:26,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:56:26,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:56:26,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. after waiting 0 ms 2023-02-11 09:56:26,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:56:26,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 35649d2f915e53acc4ab9daa7e90d4fc 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-11 09:56:26,228 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1505): Waiting on 006ee9d5c2deae1724621309680e97ab, 1588230740, 35649d2f915e53acc4ab9daa7e90d4fc, 6ad1ef294ca5f3d2b7ed061c1853e3de, 9facb323010a262708498579be7487c4, df6d5a64fc3bfc03d66e239964a4e80d, e473f47fdbb8d1df882d5c22130ea71f, fbafddcfb73c7f27cabd0c13b10473ab, fdf5a340462b75ac8dcb6a5d2682295f, ffaa59391868e3b78654a134d119206a 2023-02-11 09:56:26,428 DEBUG [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1505): Waiting on 006ee9d5c2deae1724621309680e97ab, 1588230740, 35649d2f915e53acc4ab9daa7e90d4fc, 6ad1ef294ca5f3d2b7ed061c1853e3de, 9facb323010a262708498579be7487c4, df6d5a64fc3bfc03d66e239964a4e80d, e473f47fdbb8d1df882d5c22130ea71f, fbafddcfb73c7f27cabd0c13b10473ab, fdf5a340462b75ac8dcb6a5d2682295f, ffaa59391868e3b78654a134d119206a 2023-02-11 09:56:26,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/.tmp/table/956686c612fa450b839cf23c46a4bd4e 2023-02-11 09:56:26,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 956686c612fa450b839cf23c46a4bd4e 2023-02-11 09:56:26,474 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/.tmp/info/fdef92ca45c34bf588c17aefe3a5306c as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/info/fdef92ca45c34bf588c17aefe3a5306c 2023-02-11 09:56:26,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdef92ca45c34bf588c17aefe3a5306c 2023-02-11 09:56:26,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/info/fdef92ca45c34bf588c17aefe3a5306c, entries=226, sequenceid=130, filesize=37.9 K 2023-02-11 09:56:26,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/.tmp/rep_barrier/e1345e28a00b4448b697e0b180ebb2f5 as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/rep_barrier/e1345e28a00b4448b697e0b180ebb2f5 2023-02-11 09:56:26,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1345e28a00b4448b697e0b180ebb2f5 2023-02-11 09:56:26,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/rep_barrier/e1345e28a00b4448b697e0b180ebb2f5, entries=1, sequenceid=130, filesize=5.0 K 2023-02-11 09:56:26,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/.tmp/table/956686c612fa450b839cf23c46a4bd4e as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/table/956686c612fa450b839cf23c46a4bd4e 2023-02-11 09:56:26,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 956686c612fa450b839cf23c46a4bd4e 2023-02-11 09:56:26,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/table/956686c612fa450b839cf23c46a4bd4e, entries=27, sequenceid=130, filesize=6.6 K 2023-02-11 09:56:26,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 460ms, sequenceid=130, compaction requested=false 2023-02-11 09:56:26,492 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-11 09:56:26,493 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 09:56:26,493 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 09:56:26,493 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676109386027Running coprocessor pre-close hooks at 1676109386027Disabling compacts and flushes for region at 1676109386027Disabling writes for close at 1676109386027Obtaining lock to block concurrent updates at 1676109386027Preparing flush snapshotting stores in 1588230740 at 1676109386027Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676109386027Flushing stores of hbase:meta,,1.1588230740 at 1676109386028 (+1 ms)Flushing 1588230740/info: creating writer at 1676109386028Flushing 1588230740/info: appending metadata at 1676109386033 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676109386033Flushing 1588230740/rep_barrier: creating writer at 1676109386046 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676109386049 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676109386049Flushing 1588230740/table: creating writer at 1676109386060 (+11 ms)Flushing 1588230740/table: appending metadata at 1676109386064 (+4 ms)Flushing 1588230740/table: closing flushed file at 1676109386064Flushing 1588230740/info: reopening flushed file at 1676109386475 (+411 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676109386479 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676109386483 (+4 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 460ms, sequenceid=130, compaction requested=false at 1676109386487 (+4 ms)Writing region close event to WAL at 1676109386490 (+3 ms)Running coprocessor post-close hooks at 1676109386493 (+3 ms)Closed at 1676109386493 2023-02-11 09:56:26,494 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 09:56:26,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/.tmp/info/a5cda54b570847a18a8956b767f7eebd 2023-02-11 09:56:26,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/.tmp/info/a5cda54b570847a18a8956b767f7eebd as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/info/a5cda54b570847a18a8956b767f7eebd 2023-02-11 09:56:26,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/info/a5cda54b570847a18a8956b767f7eebd, entries=3, sequenceid=7, filesize=4.8 K 2023-02-11 09:56:26,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 35649d2f915e53acc4ab9daa7e90d4fc in 416ms, sequenceid=7, compaction requested=false 2023-02-11 09:56:26,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/hbase/namespace/35649d2f915e53acc4ab9daa7e90d4fc/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-11 09:56:26,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:56:26,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 35649d2f915e53acc4ab9daa7e90d4fc: Waiting for close lock at 1676109386092Running coprocessor pre-close hooks at 1676109386092Disabling compacts and flushes for region at 1676109386092Disabling writes for close at 1676109386093 (+1 ms)Obtaining lock to block concurrent updates at 1676109386093Preparing flush snapshotting stores in 35649d2f915e53acc4ab9daa7e90d4fc at 1676109386093Finished memstore snapshotting hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676109386093Flushing stores of hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. at 1676109386093Flushing 35649d2f915e53acc4ab9daa7e90d4fc/info: creating writer at 1676109386093Flushing 35649d2f915e53acc4ab9daa7e90d4fc/info: appending metadata at 1676109386095 (+2 ms)Flushing 35649d2f915e53acc4ab9daa7e90d4fc/info: closing flushed file at 1676109386095Flushing 35649d2f915e53acc4ab9daa7e90d4fc/info: reopening flushed file at 1676109386505 (+410 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 35649d2f915e53acc4ab9daa7e90d4fc in 416ms, sequenceid=7, compaction requested=false at 1676109386509 (+4 ms)Writing region close event to WAL at 1676109386510 (+1 ms)Running coprocessor post-close hooks at 1676109386512 (+2 ms)Closed at 1676109386513 (+1 ms) 2023-02-11 09:56:26,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676109218389.35649d2f915e53acc4ab9daa7e90d4fc. 2023-02-11 09:56:26,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9facb323010a262708498579be7487c4, disabling compactions & flushes 2023-02-11 09:56:26,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:56:26,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:56:26,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. after waiting 0 ms 2023-02-11 09:56:26,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:56:26,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/9facb323010a262708498579be7487c4/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-11 09:56:26,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:56:26,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9facb323010a262708498579be7487c4: Waiting for close lock at 1676109386514Running coprocessor pre-close hooks at 1676109386514Disabling compacts and flushes for region at 1676109386514Disabling writes for close at 1676109386514Writing region close event to WAL at 1676109386514Running coprocessor post-close hooks at 1676109386516 (+2 ms)Closed at 1676109386516 2023-02-11 09:56:26,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676109290543.9facb323010a262708498579be7487c4. 2023-02-11 09:56:26,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ffaa59391868e3b78654a134d119206a, disabling compactions & flushes 2023-02-11 09:56:26,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:56:26,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:56:26,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. after waiting 0 ms 2023-02-11 09:56:26,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:56:26,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testCompactionWithHFileLink/ffaa59391868e3b78654a134d119206a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-11 09:56:26,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:56:26,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ffaa59391868e3b78654a134d119206a: Waiting for close lock at 1676109386517Running coprocessor pre-close hooks at 1676109386517Disabling compacts and flushes for region at 1676109386517Disabling writes for close at 1676109386517Writing region close event to WAL at 1676109386518 (+1 ms)Running coprocessor post-close hooks at 1676109386520 (+2 ms)Closed at 1676109386520 2023-02-11 09:56:26,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676109312561.ffaa59391868e3b78654a134d119206a. 2023-02-11 09:56:26,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fbafddcfb73c7f27cabd0c13b10473ab, disabling compactions & flushes 2023-02-11 09:56:26,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:26,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:26,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. after waiting 0 ms 2023-02-11 09:56:26,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:26,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/fbafddcfb73c7f27cabd0c13b10473ab/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 09:56:26,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:26,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fbafddcfb73c7f27cabd0c13b10473ab: Waiting for close lock at 1676109386521Running coprocessor pre-close hooks at 1676109386521Disabling compacts and flushes for region at 1676109386521Disabling writes for close at 1676109386521Writing region close event to WAL at 1676109386521Running coprocessor post-close hooks at 1676109386524 (+3 ms)Closed at 1676109386524 2023-02-11 09:56:26,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676109366554.fbafddcfb73c7f27cabd0c13b10473ab. 2023-02-11 09:56:26,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fdf5a340462b75ac8dcb6a5d2682295f, disabling compactions & flushes 2023-02-11 09:56:26,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:56:26,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:56:26,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. after waiting 0 ms 2023-02-11 09:56:26,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:56:26,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testScannerOnBulkLoadRefHFiles/fdf5a340462b75ac8dcb6a5d2682295f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 09:56:26,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:56:26,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fdf5a340462b75ac8dcb6a5d2682295f: Waiting for close lock at 1676109386524Running coprocessor pre-close hooks at 1676109386524Disabling compacts and flushes for region at 1676109386524Disabling writes for close at 1676109386524Writing region close event to WAL at 1676109386524Running coprocessor post-close hooks at 1676109386526 (+2 ms)Closed at 1676109386526 2023-02-11 09:56:26,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676109257192.fdf5a340462b75ac8dcb6a5d2682295f. 2023-02-11 09:56:26,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing df6d5a64fc3bfc03d66e239964a4e80d, disabling compactions & flushes 2023-02-11 09:56:26,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:56:26,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:56:26,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. after waiting 0 ms 2023-02-11 09:56:26,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:56:26,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithMonthlyPolicy/df6d5a64fc3bfc03d66e239964a4e80d/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-11 09:56:26,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:56:26,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for df6d5a64fc3bfc03d66e239964a4e80d: Waiting for close lock at 1676109386527Running coprocessor pre-close hooks at 1676109386527Disabling compacts and flushes for region at 1676109386527Disabling writes for close at 1676109386527Writing region close event to WAL at 1676109386527Running coprocessor post-close hooks at 1676109386529 (+2 ms)Closed at 1676109386529 2023-02-11 09:56:26,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676109235015.df6d5a64fc3bfc03d66e239964a4e80d. 2023-02-11 09:56:26,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6ad1ef294ca5f3d2b7ed061c1853e3de, disabling compactions & flushes 2023-02-11 09:56:26,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:26,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:26,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. after waiting 0 ms 2023-02-11 09:56:26,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:26,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionFromAdmin/6ad1ef294ca5f3d2b7ed061c1853e3de/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-11 09:56:26,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:26,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6ad1ef294ca5f3d2b7ed061c1853e3de: Waiting for close lock at 1676109386529Running coprocessor pre-close hooks at 1676109386529Disabling compacts and flushes for region at 1676109386529Disabling writes for close at 1676109386529Writing region close event to WAL at 1676109386530 (+1 ms)Running coprocessor post-close hooks at 1676109386532 (+2 ms)Closed at 1676109386532 2023-02-11 09:56:26,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676109366554.6ad1ef294ca5f3d2b7ed061c1853e3de. 2023-02-11 09:56:26,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e473f47fdbb8d1df882d5c22130ea71f, disabling compactions & flushes 2023-02-11 09:56:26,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:56:26,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:56:26,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. after waiting 0 ms 2023-02-11 09:56:26,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:56:26,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMinorCompactionWithWeeklyPolicy/e473f47fdbb8d1df882d5c22130ea71f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-11 09:56:26,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:56:26,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e473f47fdbb8d1df882d5c22130ea71f: Waiting for close lock at 1676109386533Running coprocessor pre-close hooks at 1676109386533Disabling compacts and flushes for region at 1676109386533Disabling writes for close at 1676109386533Writing region close event to WAL at 1676109386533Running coprocessor post-close hooks at 1676109386535 (+2 ms)Closed at 1676109386535 2023-02-11 09:56:26,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676109248056.e473f47fdbb8d1df882d5c22130ea71f. 2023-02-11 09:56:26,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 006ee9d5c2deae1724621309680e97ab, disabling compactions & flushes 2023-02-11 09:56:26,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:56:26,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:56:26,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. after waiting 0 ms 2023-02-11 09:56:26,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:56:26,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/006ee9d5c2deae1724621309680e97ab/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-11 09:56:26,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:56:26,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 006ee9d5c2deae1724621309680e97ab: Waiting for close lock at 1676109386535Running coprocessor pre-close hooks at 1676109386535Disabling compacts and flushes for region at 1676109386535Disabling writes for close at 1676109386536 (+1 ms)Writing region close event to WAL at 1676109386536Running coprocessor post-close hooks at 1676109386538 (+2 ms)Closed at 1676109386538 2023-02-11 09:56:26,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676109273855.006ee9d5c2deae1724621309680e97ab. 2023-02-11 09:56:26,614 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-11 09:56:26,628 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43463,1676109215499; all regions closed. 2023-02-11 09:56:26,635 DEBUG [RS:0;jenkins-hbase4:43463] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/oldWALs 2023-02-11 09:56:26,636 INFO [RS:0;jenkins-hbase4:43463] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43463%2C1676109215499.meta:.meta(num 1676109218150) 2023-02-11 09:56:26,639 DEBUG [RS:0;jenkins-hbase4:43463] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/oldWALs 2023-02-11 09:56:26,639 INFO [RS:0;jenkins-hbase4:43463] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43463%2C1676109215499:(num 1676109217195) 2023-02-11 09:56:26,639 DEBUG [RS:0;jenkins-hbase4:43463] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:26,639 INFO [RS:0;jenkins-hbase4:43463] regionserver.LeaseManager(133): Closed leases 2023-02-11 09:56:26,640 INFO [RS:0;jenkins-hbase4:43463] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 09:56:26,640 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 09:56:26,641 INFO [RS:0;jenkins-hbase4:43463] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43463 2023-02-11 09:56:26,646 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43463,1676109215499 2023-02-11 09:56:26,646 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 09:56:26,646 ERROR [Listener at localhost/44465-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@891710e rejected from java.util.concurrent.ThreadPoolExecutor@caef4c4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 09:56:26,646 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 09:56:26,646 ERROR [Listener at localhost/44465-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b35e68b rejected from java.util.concurrent.ThreadPoolExecutor@caef4c4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 09:56:26,647 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43463,1676109215499] 2023-02-11 09:56:26,648 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43463,1676109215499; numProcessing=1 2023-02-11 09:56:26,649 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43463,1676109215499 already deleted, retry=false 2023-02-11 09:56:26,649 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43463,1676109215499 expired; onlineServers=0 2023-02-11 09:56:26,649 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46823,1676109214337' ***** 2023-02-11 09:56:26,649 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 09:56:26,649 DEBUG [M:0;jenkins-hbase4:46823] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72ea7a64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 09:56:26,649 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46823,1676109214337 2023-02-11 09:56:26,649 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46823,1676109214337; all regions closed. 2023-02-11 09:56:26,649 DEBUG [M:0;jenkins-hbase4:46823] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 09:56:26,649 DEBUG [M:0;jenkins-hbase4:46823] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 09:56:26,650 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 09:56:26,650 DEBUG [M:0;jenkins-hbase4:46823] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 09:56:26,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676109216892] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676109216892,5,FailOnTimeoutGroup] 2023-02-11 09:56:26,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676109216892] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676109216892,5,FailOnTimeoutGroup] 2023-02-11 09:56:26,650 INFO [M:0;jenkins-hbase4:46823] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 09:56:26,650 INFO [M:0;jenkins-hbase4:46823] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 09:56:26,650 INFO [M:0;jenkins-hbase4:46823] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 09:56:26,651 DEBUG [M:0;jenkins-hbase4:46823] master.HMaster(1502): Stopping service threads 2023-02-11 09:56:26,651 INFO [M:0;jenkins-hbase4:46823] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 09:56:26,651 ERROR [M:0;jenkins-hbase4:46823] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-11 09:56:26,651 INFO [M:0;jenkins-hbase4:46823] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 09:56:26,652 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 09:56:26,654 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 09:56:26,654 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 09:56:26,655 DEBUG [M:0;jenkins-hbase4:46823] zookeeper.ZKUtil(398): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 09:56:26,655 WARN [M:0;jenkins-hbase4:46823] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 09:56:26,655 INFO [M:0;jenkins-hbase4:46823] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 09:56:26,655 INFO [M:0;jenkins-hbase4:46823] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 09:56:26,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 09:56:26,655 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 09:56:26,655 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:56:26,655 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:56:26,655 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 09:56:26,655 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:56:26,655 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.81 KB heapSize=598.62 KB 2023-02-11 09:56:26,747 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 09:56:26,747 INFO [RS:0;jenkins-hbase4:43463] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43463,1676109215499; zookeeper connection closed. 2023-02-11 09:56:26,748 ERROR [Listener at localhost/44465-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3dc32e7 rejected from java.util.concurrent.ThreadPoolExecutor@caef4c4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 09:56:26,748 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): regionserver:43463-0x10042ccd8fe0001, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 09:56:26,748 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c3bf1bd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c3bf1bd 2023-02-11 09:56:26,748 ERROR [Listener at localhost/44465-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d562e7f rejected from java.util.concurrent.ThreadPoolExecutor@caef4c4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 09:56:26,748 INFO [Listener at localhost/44465] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-11 09:56:27,063 INFO [M:0;jenkins-hbase4:46823] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.81 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/497d7453a4f04c51bab012c4659e12eb 2023-02-11 09:56:27,067 INFO [M:0;jenkins-hbase4:46823] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 497d7453a4f04c51bab012c4659e12eb 2023-02-11 09:56:27,067 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/497d7453a4f04c51bab012c4659e12eb as hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/497d7453a4f04c51bab012c4659e12eb 2023-02-11 09:56:27,071 INFO [M:0;jenkins-hbase4:46823] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 497d7453a4f04c51bab012c4659e12eb 2023-02-11 09:56:27,071 INFO [M:0;jenkins-hbase4:46823] regionserver.HStore(1080): Added hdfs://localhost:39621/user/jenkins/test-data/827d32ed-12c7-11f6-f81c-b2e4506d2f99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/497d7453a4f04c51bab012c4659e12eb, entries=123, sequenceid=1006, filesize=33.3 K 2023-02-11 09:56:27,072 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(2947): Finished flush of dataSize ~512.81 KB/525115, heapSize ~598.60 KB/612968, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1006, compaction requested=false 2023-02-11 09:56:27,072 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 09:56:27,073 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676109386655Disabling compacts and flushes for region at 1676109386655Disabling writes for close at 1676109386655Obtaining lock to block concurrent updates at 1676109386655Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676109386655Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525115, getHeapSize=612968, getOffHeapSize=0, getCellsCount=1161 at 1676109386655Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676109386656 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676109386656Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676109386659 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676109386659Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676109387068 (+409 ms)Finished flush of dataSize ~512.81 KB/525115, heapSize ~598.60 KB/612968, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1006, compaction requested=false at 1676109387072 (+4 ms)Writing region close event to WAL at 1676109387072Closed at 1676109387072 2023-02-11 09:56:27,075 INFO [M:0;jenkins-hbase4:46823] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 09:56:27,075 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 09:56:27,075 INFO [M:0;jenkins-hbase4:46823] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46823 2023-02-11 09:56:27,077 DEBUG [M:0;jenkins-hbase4:46823] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46823,1676109214337 already deleted, retry=false 2023-02-11 09:56:27,178 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 09:56:27,178 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46823,1676109214337; zookeeper connection closed. 2023-02-11 09:56:27,179 ERROR [Listener at localhost/44465-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31988f4e rejected from java.util.concurrent.ThreadPoolExecutor@71eb4e60[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 09:56:27,179 DEBUG [Listener at localhost/44465-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10042ccd8fe0000, quorum=127.0.0.1:62294, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 09:56:27,179 ERROR [Listener at localhost/44465-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34cb46a1 rejected from java.util.concurrent.ThreadPoolExecutor@71eb4e60[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 09:56:27,180 WARN [Listener at localhost/44465] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 09:56:27,183 INFO [Listener at localhost/44465] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 09:56:27,290 WARN [BP-1410530437-172.31.14.131-1676109211247 heartbeating to localhost/127.0.0.1:39621] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 09:56:27,290 WARN [BP-1410530437-172.31.14.131-1676109211247 heartbeating to localhost/127.0.0.1:39621] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1410530437-172.31.14.131-1676109211247 (Datanode Uuid d887973e-79f0-4a8e-b8a4-a839fbe55eb2) service to localhost/127.0.0.1:39621 2023-02-11 09:56:27,292 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439/dfs/data/data1/current/BP-1410530437-172.31.14.131-1676109211247] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 09:56:27,293 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/18166283-45e7-4758-1d57-568f3b863b9f/cluster_b0a916cb-f497-2999-6be0-bfb1e6d4a439/dfs/data/data2/current/BP-1410530437-172.31.14.131-1676109211247] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 09:56:27,320 INFO [Listener at localhost/44465] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 09:56:27,455 INFO [Listener at localhost/44465] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 09:56:27,569 INFO [Listener at localhost/44465] hbase.HBaseTestingUtility(1293): Minicluster is down